-- Logs begin at Wed 2021-12-15 15:38:44 UTC, end at Wed 2021-12-15 17:06:13 UTC. -- Dec 15 16:12:23.081654 dv-cinder-820027-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 16:12:23.091203 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 16:12:23 2021] *** Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: nodename: dv-cinder-820027-2-iscsi Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: machine: x86_64 Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: clock source: unix Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: pcre jit disabled Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: detected number of CPU cores: 4 Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: current working directory: / Dec 15 16:12:23.093146 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: detected binary path: /usr/bin/uwsgi-core Dec 15 16:12:23.093760 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: your processes number limit is 47680 Dec 15 16:12:23.093760 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: your memory page size is 4096 bytes Dec 15 16:12:23.093760 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: detected max file descriptor number: 2048 Dec 15 16:12:23.093760 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: lock engine: pthread robust mutexes Dec 15 16:12:23.093760 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: thunder lock: enabled Dec 15 16:12:23.093760 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 16:12:23.093760 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 16:12:23.137715 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: Python main interpreter initialized at 0x55de257899c0 Dec 15 16:12:23.137715 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: python threads support enabled Dec 15 16:12:23.137715 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: your server socket listen backlog is limited to 100 connections Dec 15 16:12:23.137715 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: your mercy for graceful operations on workers is 90 seconds Dec 15 16:12:23.138132 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 16:12:23.138132 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: *** Operational MODE: preforking *** Dec 15 16:12:23.138446 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: *** uWSGI is running in multiple interpreter mode *** Dec 15 16:12:23.138446 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: spawned uWSGI master process (pid: 101777) Dec 15 16:12:23.138645 dv-cinder-820027-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 16:12:23.140748 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: spawned uWSGI worker 1 (pid: 101778, cores: 1) Dec 15 16:12:23.140748 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: spawned uWSGI worker 2 (pid: 101779, cores: 1) Dec 15 16:12:23.140748 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 16:12:24.877942 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:12:24.877942 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: from cryptography.utils import int_from_bytes Dec 15 16:12:24.878666 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:12:24.878666 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: from cryptography.utils import int_from_bytes Dec 15 16:12:24.878787 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:12:24.878787 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: from cryptography.utils import int_from_bytes Dec 15 16:12:24.879234 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:12:24.879234 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: from cryptography.utils import int_from_bytes Dec 15 16:12:27.495650 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:12:27.496933 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:12:27.496933 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:12:27.497198 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:12:27.497322 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:12:27.497892 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:12:27.498025 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:12:27.498165 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.498298 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:12:27.498429 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.498558 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:12:27.498684 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.498803 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:12:27.498934 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.499061 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.499199 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.499328 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.499448 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.499681 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.499801 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.499924 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.500047 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.500161 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.500288 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.500288 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.500549 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.500687 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.500804 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.500920 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-2-iscsi {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.501044 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.501243 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.501676 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.501892 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.502031 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.502188 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.502327 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.502468 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.502601 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-2-iscsi {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.502799 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.502934 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.503083 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.503205 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.503394 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.503535 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.503943 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.504084 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.504084 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.504295 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.504416 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.504593 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.504700 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.504815 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.504920 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.505067 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.505228 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.505382 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.505477 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.505692 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.505787 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.506091 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.506183 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.506413 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.506515 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.506724 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.506827 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.507218 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.507319 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-2-iscsi {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.507654 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.507842 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.508011 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.508296 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.508413 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.508644 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.508791 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.509084 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.509240 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-2-iscsi {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.509447 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.509631 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.509785 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.509969 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.510118 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.510261 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.510418 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.510545 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.510700 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.510822 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.510949 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.511138 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.511264 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.511468 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.511595 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.511801 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.511939 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.512115 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.512241 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.512420 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.512573 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.512762 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.512921 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.513091 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.513230 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.513401 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.513527 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.513709 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.513835 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.514000 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.514128 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.514254 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.514375 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.514569 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.514695 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.514892 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.515036 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.515214 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.515345 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.515535 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.515672 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.515792 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.515911 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.516036 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.516163 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.516315 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.516506 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.516653 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.516778 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.516961 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.517091 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.517210 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.517329 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.517523 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.517649 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.517847 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.517980 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.518151 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.518283 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.518459 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.518594 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.518765 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.518895 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.519073 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.519203 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.519385 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.519517 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.519695 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.519829 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.520002 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.520124 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.520310 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.520459 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.520661 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.520797 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.520980 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.521109 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.521291 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.521423 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.521625 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.521749 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.521942 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.522064 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.522252 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.522376 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.522676 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.522806 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.523000 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.523124 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.523309 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.523439 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.523618 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.523748 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.523928 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.524060 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.524252 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.524377 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.524608 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.524731 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.524919 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.525041 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.525177 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.525303 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.525459 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.525585 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.525766 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.525892 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.526087 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.526208 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.526380 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.526511 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.526688 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.526821 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.526998 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.527128 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.527298 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.527427 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.527606 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.527738 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.527914 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.528039 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.528220 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.528343 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.528550 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.528686 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.528852 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.528975 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.529156 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.529278 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.529465 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.529607 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.529770 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.529895 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.530078 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.530202 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.530387 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.530512 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.530696 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.530826 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.531001 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.531125 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.531311 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.531436 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.531622 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.531755 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.531930 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.532063 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.532254 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.532384 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.532587 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.532711 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.532896 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.533018 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.533204 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.533329 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.533514 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.533646 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.533825 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.533950 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.534134 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.534258 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.534441 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.534565 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.534752 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.534877 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.535077 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.535202 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.535383 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.535506 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.535689 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.535810 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.536005 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.536129 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.536313 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.536464 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.536667 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.536792 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.536977 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.537103 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.537310 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.537448 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.537592 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.537730 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.537875 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.538001 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.538261 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.538392 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.538574 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.538711 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.538886 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.539016 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.539196 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.539329 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.539508 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.539642 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.539816 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.539941 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.540126 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.540251 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.540519 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.540666 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.540787 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.540905 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.541083 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.541207 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.541432 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.541574 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.541741 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.541867 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.542053 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.542185 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.542380 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:27.542513 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.542726 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.542852 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.543066 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.543197 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.543384 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.543507 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.543705 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.543838 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.544040 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.544209 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.544342 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.544523 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.544679 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.544805 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.544997 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.545136 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.545319 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.545459 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.545672 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.545840 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.545973 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.546135 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.546293 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.546450 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.546590 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.546834 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.547042 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.547262 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.547427 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.547603 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.547728 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.547849 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.547971 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.548125 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.548284 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.548416 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.548561 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.548805 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.548998 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.549192 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.549306 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.549433 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.549563 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.549772 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.549947 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.550093 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.550219 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.550377 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.550507 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.550712 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.551001 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.551171 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.551304 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.551426 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.551644 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.551820 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.551963 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.552090 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.552209 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.552417 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.552615 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.552744 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.552884 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.553082 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.553259 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.553388 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.553521 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.553828 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.554027 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.554162 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.554278 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.554444 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.554718 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.554861 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.554984 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.555105 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.555230 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.555351 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.555470 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.555636 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.555760 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.555974 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.556096 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.556297 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.556508 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.556647 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.556776 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.556926 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.557049 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.557234 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.557359 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.557557 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.557676 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.557860 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.557989 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.558167 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.558302 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.558490 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.558613 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.558805 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.558980 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.559106 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.559235 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.559423 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.559546 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.559729 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.559860 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.560032 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.560239 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.560359 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.560586 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.560710 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.560954 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.561089 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.561284 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.561407 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.561610 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.561734 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.561925 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.562056 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.562239 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.562362 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.562574 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.562706 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.562907 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.563038 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.563216 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.563339 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.563544 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.563675 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.563871 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.564002 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.564204 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.564337 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.564525 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.564650 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.564841 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.564981 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.565148 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.565284 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.565458 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.565641 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.565777 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.565983 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.566112 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.566297 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.566419 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.566633 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.566762 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.566941 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.567062 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.567246 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.567368 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.567551 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.567686 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.567866 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.567993 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.568178 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.568300 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.568505 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.568643 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.568815 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.568940 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.569129 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.569252 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.569621 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.569925 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.570071 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.570197 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.570318 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.570438 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.570569 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.570690 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.570810 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.570929 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.571093 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.571222 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.571435 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.571609 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.571751 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.571876 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.572031 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.572161 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.572379 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.572619 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.572754 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.572877 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.572998 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.573132 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.573332 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.573517 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.573649 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.573772 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.573929 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.574064 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.574269 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.574443 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.574574 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.574698 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.574901 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.575095 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.575231 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.575355 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.575485 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.575676 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.575852 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.575999 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.576132 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.576256 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.576511 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.576686 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.576817 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.577028 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.577164 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.577288 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.577408 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.577535 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.577750 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.577926 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.578057 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.578191 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.578316 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.578461 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.578663 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.578831 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.578953 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.579068 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.579290 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.579467 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.579616 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.579751 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.579876 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.580081 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.580257 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.580391 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.580598 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.580724 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.580844 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.581042 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.581217 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.581360 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.581494 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.581640 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.581767 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.581985 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.582160 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.582303 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.582428 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.582617 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.582744 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.582927 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.583055 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.583287 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.583421 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.583598 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.583723 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.583913 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.584046 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.584229 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.584368 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.584574 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.584700 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.584881 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.585259 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.585259 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.585509 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.585639 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.585760 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.586056 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.586189 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.586374 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.586500 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.586687 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.586821 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.587011 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.587145 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.587319 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.587447 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.587637 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.587764 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.587944 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.588078 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.588255 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.588388 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.588608 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.588749 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.588911 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.589035 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.589236 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.589385 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.589545 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.589679 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.589862 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.589986 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.590169 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.590291 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.590492 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.590617 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.590802 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.590927 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.591107 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.591232 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.591379 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.591501 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.591704 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.591833 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.592032 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.592155 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.592349 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.592501 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.592671 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.592796 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.593003 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.593137 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.593294 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.593443 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.593619 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.593751 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.593931 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.594056 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.594243 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.594375 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.594554 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.594679 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.594859 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.594982 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.595169 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.595306 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.595465 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.595588 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.595787 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.595920 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.596104 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.596244 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.596413 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.596571 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.596751 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.596875 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.597065 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.597185 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.597375 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.597499 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.597687 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.597813 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.597992 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.598116 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.598299 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.598425 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.598609 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.598734 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.598913 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.599036 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.599247 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.599503 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.599626 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.599837 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.599972 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.600154 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.600275 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.600497 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.600691 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.600861 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.601042 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.601166 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.601369 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.601499 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.601708 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.601838 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.602042 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.602164 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.602359 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.602482 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.602670 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.602936 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.603068 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.603275 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.603408 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.603579 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.603707 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.603893 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.604024 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.604204 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.604320 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.604537 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.604675 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.605157 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.605281 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.605474 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.605598 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.605782 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.605912 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.606090 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.606212 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.606422 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.606542 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.606726 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.606928 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.607062 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.607181 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.607332 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.607461 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.607643 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.607772 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.607952 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.608073 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.608262 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.608383 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.608600 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.608723 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.608909 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.609039 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.609216 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.609336 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.609520 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.609648 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.609859 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.609982 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.610162 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.610291 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.610494 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.610622 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.610810 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.610945 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.611118 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.611247 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.611447 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.611567 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.611757 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.611875 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.612061 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.612187 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.612369 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.612583 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.612716 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.612835 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.612990 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.613113 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.613304 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.613426 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.613600 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.613732 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.613906 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.614029 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.614219 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.614352 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.614529 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.614659 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.614842 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.614964 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.615153 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.615287 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.615455 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.615577 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.615766 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.615888 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.616072 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.616203 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.616454 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.616590 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.616774 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.616895 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.617087 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.617218 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.617402 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.617525 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.617714 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.617835 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.618031 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.618163 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.618346 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.618468 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.618654 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.618775 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.618961 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.619089 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.619265 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.619392 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.619583 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.619705 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.619885 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.620007 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.620188 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.620309 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.620517 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.620642 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.620834 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.620958 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.621140 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.621267 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.621448 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.621568 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.621763 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.621893 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.622069 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.622189 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.622377 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.622509 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.622690 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.622811 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.622995 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.623116 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.623296 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.623425 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.623610 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.623731 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.623923 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.624045 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.624232 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.624363 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.624562 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.624683 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.624877 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.624999 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.625185 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.625322 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.625493 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.625621 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.625818 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.625948 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.626118 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.626241 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.626423 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.626545 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.626731 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.626853 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.627041 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.627167 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.627349 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.627471 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.627657 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.627779 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.627986 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.628109 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.628305 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.628446 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.628649 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.628765 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.628957 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.629080 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.629266 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.629410 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.629612 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.629744 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.629923 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.630045 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.630285 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.630416 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.630598 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.630800 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.630923 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.631041 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.631222 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.631345 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.631535 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.631690 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.631904 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.632138 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.632386 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.632789 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.632913 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.633132 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.633256 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.633450 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.633578 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.633770 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.633901 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.634080 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.634203 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.634387 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.634509 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.634715 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.634846 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.635030 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.635152 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.635345 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.635467 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.635671 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.635803 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.635997 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.636120 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.636330 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.636487 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.636669 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.636806 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.636984 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.637106 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.637295 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.637423 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.637600 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.637720 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.637908 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.638030 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.638240 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.638371 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.638504 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.638631 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.638815 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.638944 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.639134 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.639270 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.639447 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.639570 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.639758 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.639881 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.640066 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.640190 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.640380 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.640564 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.640718 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.640840 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.641025 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.641158 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.641342 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.641462 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.641655 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.641782 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.641964 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.642098 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.642274 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.642403 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.642576 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.642696 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.642887 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.643021 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.643192 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.643313 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.643499 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.643626 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.643814 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.643944 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.644129 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.644253 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.644481 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.644617 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.644820 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.644943 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.645137 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.645258 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.645447 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.645570 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.645763 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.645884 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.646070 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.646190 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.646387 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.646513 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.646698 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.646820 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.647088 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.647215 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.647405 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.647690 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.647829 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.647948 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.648142 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.648265 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.648484 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.648625 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.648805 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.648928 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.649190 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.649313 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.649434 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.649562 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.649750 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.649873 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.650097 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.650217 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.650409 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.650538 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.650737 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.650866 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.651084 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.651205 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.651403 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.651534 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.651712 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.651835 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.652027 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.652150 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.652382 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.652529 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.652721 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.652857 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.653031 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.653153 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.653340 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.653470 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.653671 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.653982 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.654168 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.654310 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.654485 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.654736 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.654860 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.655054 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.655176 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.655364 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.655494 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.655785 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.656102 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.656419 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.656771 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.657102 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.657432 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.657745 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.658066 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.658382 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.658713 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.659046 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.659364 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.659652 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.659766 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.659979 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.660088 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.660311 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.660423 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.660669 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.660792 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.660989 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.661111 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.661321 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.661443 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.661706 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.661825 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.662051 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.662186 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.662363 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.662504 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.662691 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.662814 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.663023 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.663229 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.663423 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.663656 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.663839 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.664038 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.664250 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.664537 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.664738 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.664965 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.665164 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.665355 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.665543 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.665838 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.665962 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.666093 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.666224 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.666344 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.666473 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.666601 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.666722 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.666849 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.666970 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.667089 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.667206 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.667333 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.667620 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.667742 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.667939 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.668269 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.668390 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.668649 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.668919 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.669051 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.669246 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.669491 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.669620 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.670131 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.670279 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.670411 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.670558 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.670674 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.670776 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.670868 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.670967 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.671085 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.671218 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.671410 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.671551 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.671749 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.671871 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.672085 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.672208 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.672490 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.672591 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.672863 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.672938 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.673089 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.673167 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.673505 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.673662 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.673819 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.673970 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.674126 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.674271 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.674414 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.674569 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.674785 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.674938 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.675096 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.675252 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.675417 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.675578 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.675722 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.675863 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.676007 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.676151 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.676302 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.676509 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.676600 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.676875 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.676993 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.677084 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.677184 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.677273 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.677553 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.677690 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.677874 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.678013 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.678182 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.678346 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.678494 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.678666 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.679373 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.679467 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.679557 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.679647 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.679734 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.679814 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.679893 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.680020 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.680115 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.680336 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.680422 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.680706 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.680833 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.681041 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.681183 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.681370 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.681502 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.681682 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.681812 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.681993 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.682154 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.682303 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.682426 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.682652 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.682782 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.682962 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.683085 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.683283 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.683412 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.683606 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.683729 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.683927 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.684051 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.684248 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.684378 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.684585 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.684717 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.684900 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.685022 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.685241 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.685418 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.685540 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.685658 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.685845 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.685970 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.686166 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.686415 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.686546 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.686749 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.686873 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.687279 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.687423 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.687546 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.687669 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.687798 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.687926 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.688046 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.688172 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.688349 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.688492 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.688689 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.688939 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.689063 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.689271 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.689394 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.689591 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.689723 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.689911 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.690042 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.690227 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.690350 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.690546 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.690670 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.690863 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.690988 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.691178 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.691301 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.691494 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.691618 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.691811 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.691941 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.692127 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.692250 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.692497 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.692638 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.692807 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.692939 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.693118 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.693248 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.693438 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.693568 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.693759 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.693890 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.694073 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.694203 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.694436 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.694567 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.694755 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.694959 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.695087 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.695213 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.695373 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.695495 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.695692 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.695823 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.696010 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.696133 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.696326 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.696461 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.696670 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.696806 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.696987 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.697111 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.697303 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.697434 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.697621 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.697758 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.697936 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.698060 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.698254 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.698378 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.698570 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.698700 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.698885 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.699095 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.699218 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.699415 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.699731 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.699885 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.700016 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.700137 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.700272 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.700392 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.700576 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.700699 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.700818 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.701032 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.701171 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.701423 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.701589 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.701722 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.701906 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.702033 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.702246 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.702369 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.702564 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.702687 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.702877 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.703001 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.703207 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.703336 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.703520 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.703643 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.703830 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.703953 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.704136 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.704267 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.704461 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.704588 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.704780 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.705006 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.705139 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.705359 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.705489 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.705680 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.705802 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.705995 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.706127 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.706299 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.706423 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.706619 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.706742 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.706926 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.707125 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.707249 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.707457 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.707582 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.707806 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.707930 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.708126 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.708250 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.708466 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.708591 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.708784 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.708909 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.709097 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.709222 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.709405 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.709527 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.709716 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.709838 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.710091 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.710230 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.710407 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.710530 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.710727 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.710864 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.711040 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.711177 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.711374 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.711500 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.711621 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.711750 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.711937 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.712062 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.712249 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.712380 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.712583 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.712727 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.712903 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.713037 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.713210 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.713341 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.713538 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.713677 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.713847 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.713972 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.714152 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.714274 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.714473 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.714605 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.714742 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.714879 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.715051 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.715161 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.715357 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.715434 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.715662 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.715738 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.715968 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.716042 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.716280 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.716355 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.716613 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.716695 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.716921 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.716998 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.717224 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.717307 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.717537 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.717613 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.717843 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.717927 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.718151 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.718264 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.718458 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.718557 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.718784 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.718892 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.719093 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.719184 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.719401 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.719670 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.719760 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.720015 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.720106 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.720343 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.720456 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.720688 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.720779 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.721001 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.721093 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.721352 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.721446 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.721676 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.721780 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.721992 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.722250 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.722382 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.722641 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.722774 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.722961 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.723108 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.723245 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.723353 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.723589 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.723736 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.723908 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.724040 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.724222 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.724352 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.724557 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.724692 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.724873 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.725003 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.725188 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.725321 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.725502 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.725668 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.725841 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.726051 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.726161 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.726442 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.726638 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.726738 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.726821 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.727044 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.727134 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.727358 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.727449 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.727670 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.727767 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.727989 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.728095 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.728297 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.728404 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.728650 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.728746 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.728976 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.729065 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.729299 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.729399 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.729617 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.729707 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.730232 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.730333 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.730545 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.730642 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.730859 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.730949 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.731175 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.731265 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.731494 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.731597 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.731830 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.731921 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.732149 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.732241 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.732458 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.732911 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.733002 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.733224 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.733323 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.733532 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.733628 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.733845 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.733930 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.734154 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.734245 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.734480 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.734567 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.734811 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.734896 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.735124 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.735211 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.735446 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.735532 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.735756 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.735841 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.736063 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.736154 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.736402 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.736550 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.736760 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.736845 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.737090 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.737189 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.737404 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.737503 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.737714 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.737801 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.738022 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.738116 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.738340 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.738448 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.738652 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.738745 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.738982 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.739085 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.739305 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.739390 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.739617 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.739706 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.739931 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.740042 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.740258 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.740346 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.740596 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.740684 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.740920 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.741008 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.741380 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.741712 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.741802 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.741919 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.742247 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.742433 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.742754 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.742840 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.743088 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.743392 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.743487 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.743725 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.743918 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.744066 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.744390 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.745759 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.745865 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746003 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746089 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746214 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746301 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746301 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746571 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746704 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746790 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746870 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.746870 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.747031 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.747119 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.747240 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.747354 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.747604 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.747859 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.747963 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.748194 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.748493 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.748653 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.748844 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.748953 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.749200 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.749317 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.749653 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.749757 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.750052 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.750370 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.750468 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.750706 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.750793 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.751043 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.751140 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.751373 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.751461 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.751619 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:12:27.751704 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.752020 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.752352 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.752727 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.753069 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.753412 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.753768 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.754104 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.754428 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.754782 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.755120 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.755446 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.755766 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.756079 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:27.756345 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:12:27.776815 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:27.779911 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:27.845223 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.context [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),144f1872-fd4a-4f70-bcac-e90acefa618e(cell1) {{(pid=101779) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:12:27.845910 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.context [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),144f1872-fd4a-4f70-bcac-e90acefa618e(cell1) {{(pid=101778) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:12:27.849535 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.850206 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.851221 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.851895 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.852049 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.852771 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:27.853973 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.854760 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:27.864983 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:27.868020 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:27.871021 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:27.874768 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:28.034108 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:28.051426 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:28.394605 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:12:28.397194 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:12:28.401636 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:12:28.404310 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:12:28.743640 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:12:28.746287 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:12:28.748926 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:12:28.751530 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:12:28.754098 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de257899c0 pid: 101779 (default app) Dec 15 16:12:28.756234 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:28.756922 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de257899c0 pid: 101778 (default app) Dec 15 16:12:28.757517 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-5750e658-a1c1-4600-961f-4b0bf62c243f None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001881 Dec 15 16:12:28.757922 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Wed Dec 15 16:12:28 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:55.309332 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:55.311369 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003572 Dec 15 16:13:55.311911 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:13:55 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:55.873114 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-070a2554-b132-4e8e-b237-5da35c561007 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:55.907943 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-070a2554-b132-4e8e-b237-5da35c561007 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.587989 Dec 15 16:13:55.909082 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Dec 15 16:13:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:13:58.672205 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:13:58.673963 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-f2cee964-09aa-477b-b888-f2cbca2a0339 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002460 Dec 15 16:13:58.674390 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 2/4] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:13:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:13:58.744957 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-31034a5c-6de1-4d7d-b173-9fd5117badad admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:58.763437 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:58.763437 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Dec 15 16:13:58.794616 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-31034a5c-6de1-4d7d-b173-9fd5117badad admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.113155 Dec 15 16:13:58.803057 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 3/5] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:13:58 2021] POST /compute/v2.1/flavors => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:13:59.013902 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-b7b8b10d-18f8-4e7d-a1f8-f209f83f26bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:13:59.016416 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:13:59.016416 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: warnings.warn(msg) Dec 15 16:13:59.067766 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-b7b8b10d-18f8-4e7d-a1f8-f209f83f26bf admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262932 Dec 15 16:13:59.072885 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 3/6] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Dec 15 16:13:58 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:01.653889 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-31034a5c-6de1-4d7d-b173-9fd5117badad admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:01.654903 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-31034a5c-6de1-4d7d-b173-9fd5117badad admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Dec 15 16:14:01.655324 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 4/7] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:01.777276 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-46363fdd-28c2-4f9f-be0e-b363e877726c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "id": "d1", "swap": 0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:01.795334 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:01.795334 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: warnings.warn(msg) Dec 15 16:14:01.815596 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-46363fdd-28c2-4f9f-be0e-b363e877726c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152681 Dec 15 16:14:01.816151 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 4/8] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:01.829653 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-e236b584-61d2-4b35-9135-0ed1f772220c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:01.831352 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:01.831352 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Dec 15 16:14:01.871045 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-e236b584-61d2-4b35-9135-0ed1f772220c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045645 Dec 15 16:14:01.871645 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 5/9] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Dec 15 16:14:01 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:04.737013 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-46363fdd-28c2-4f9f-be0e-b363e877726c admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:04.738889 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-46363fdd-28c2-4f9f-be0e-b363e877726c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002193 Dec 15 16:14:04.739598 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:04 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:04.822337 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-70726c48-d830-4268-867b-052a77a376eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:04.851287 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-70726c48-d830-4268-867b-052a77a376eb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099980 Dec 15 16:14:04.852153 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 6/11] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:04 2021] POST /compute/v2.1/flavors => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:04.873309 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-a970c108-c1ad-4441-bb95-be11c81b54cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:04.910385 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-a970c108-c1ad-4441-bb95-be11c81b54cf admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044316 Dec 15 16:14:04.912050 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 6/12] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Dec 15 16:14:04 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:07.867387 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-70726c48-d830-4268-867b-052a77a376eb admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:07.868903 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-70726c48-d830-4268-867b-052a77a376eb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005822 Dec 15 16:14:07.869494 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 7/13] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:07 2021] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:07.947564 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-0ac0d278-d78c-44f1-81ae-ce7c9cddcafd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:07.978476 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-0ac0d278-d78c-44f1-81ae-ce7c9cddcafd admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099852 Dec 15 16:14:07.979728 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 7/14] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:07.993012 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-ef573c4c-7f05-4317-ba11-93541b3d3a54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:08.027967 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-ef573c4c-7f05-4317-ba11-93541b3d3a54 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038298 Dec 15 16:14:08.029349 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 8/15] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Dec 15 16:14:07 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:10.873120 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-0ac0d278-d78c-44f1-81ae-ce7c9cddcafd admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:10.875691 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-0ac0d278-d78c-44f1-81ae-ce7c9cddcafd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003264 Dec 15 16:14:10.876363 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 8/16] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:10 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:10.989271 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-0759b1ec-0c87-44e8-bbf9-41c30536d951 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:11.013142 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-0759b1ec-0c87-44e8-bbf9-41c30536d951 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.125291 Dec 15 16:14:11.013954 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 9/17] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:11.035819 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-1a2483d8-f26e-49f0-8a1b-93dfe9b784de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:11.073753 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-1a2483d8-f26e-49f0-8a1b-93dfe9b784de admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044194 Dec 15 16:14:11.074729 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 9/18] 10.222.0.30 () {64 vars in 1335 bytes} [Wed Dec 15 16:14:11 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:13.716668 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-0759b1ec-0c87-44e8-bbf9-41c30536d951 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:13.717687 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-0759b1ec-0c87-44e8-bbf9-41c30536d951 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Dec 15 16:14:13.718091 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 10/19] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:13.793516 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-457af31a-9c51-43b8-aa3e-44f3454edfe3 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:13.818518 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-457af31a-9c51-43b8-aa3e-44f3454edfe3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092362 Dec 15 16:14:13.819109 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 10/20] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Dec 15 16:14:13 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:16.517964 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-0759b1ec-0c87-44e8-bbf9-41c30536d951 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:16.520462 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-0759b1ec-0c87-44e8-bbf9-41c30536d951 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002219 Dec 15 16:14:16.521161 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 11/21] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:16 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:16.626424 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-33a8fc45-e50a-47f7-a90b-f3c82344c03b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "1", "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:16.666583 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-33a8fc45-e50a-47f7-a90b-f3c82344c03b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.136534 Dec 15 16:14:16.667344 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 11/22] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:16 2021] POST /compute/v2.1/flavors => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:16.683558 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-aee1bb07-ca5a-4377-878d-1e99e3bb911b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:16.718693 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-aee1bb07-ca5a-4377-878d-1e99e3bb911b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039094 Dec 15 16:14:16.719644 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 12/23] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:16 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:19.456498 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-33a8fc45-e50a-47f7-a90b-f3c82344c03b admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:19.457518 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-33a8fc45-e50a-47f7-a90b-f3c82344c03b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Dec 15 16:14:19.457939 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 12/24] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:19.525040 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-fc58c6c2-5494-447e-b023-42ff58f3f3cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "disk": 20, "id": "2", "rxtx_factor": 1.0, "swap": 0}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:19.547368 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-fc58c6c2-5494-447e-b023-42ff58f3f3cf admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081941 Dec 15 16:14:19.547944 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 13/25] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:19 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:19.563042 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-73f26cc6-6e98-4a41-a4f3-e6ea6ba070b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:19.593246 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-73f26cc6-6e98-4a41-a4f3-e6ea6ba070b1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034857 Dec 15 16:14:19.594266 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 13/26] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:19 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:22.178150 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-fc58c6c2-5494-447e-b023-42ff58f3f3cf admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:22.179257 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-fc58c6c2-5494-447e-b023-42ff58f3f3cf admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Dec 15 16:14:22.179767 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 14/27] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:22.247578 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-e0b04065-d978-42ed-b140-743694679ba1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:22.268060 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-e0b04065-d978-42ed-b140-743694679ba1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081611 Dec 15 16:14:22.268914 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 14/28] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:22 2021] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:22.281306 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-600e8e41-c512-4ed9-8c40-3ad40c5d67b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:22.305789 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-600e8e41-c512-4ed9-8c40-3ad40c5d67b6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028339 Dec 15 16:14:22.306385 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 15/29] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:22 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:25.026824 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-e0b04065-d978-42ed-b140-743694679ba1 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:25.029422 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-e0b04065-d978-42ed-b140-743694679ba1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005276 Dec 15 16:14:25.036976 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 15/30] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:25 2021] GET /compute/v2.1 => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:25.099431 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-1c113a36-be34-4efc-861e-0772fe6ccf71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:25.122030 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-1c113a36-be34-4efc-861e-0772fe6ccf71 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082408 Dec 15 16:14:25.122788 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 16/31] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:25.135836 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-d7d83070-a47e-4e51-8b89-e5a93ae21fae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:25.165219 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-d7d83070-a47e-4e51-8b89-e5a93ae21fae admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033087 Dec 15 16:14:25.183258 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 16/32] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:25 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:27.777781 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-1c113a36-be34-4efc-861e-0772fe6ccf71 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:27.779751 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-1c113a36-be34-4efc-861e-0772fe6ccf71 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002499 Dec 15 16:14:27.780290 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 17/33] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:27 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:27.858826 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5b2826be-54d7-44c3-8d03-2cd0a86505a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "id": "5"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:27.880352 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5b2826be-54d7-44c3-8d03-2cd0a86505a2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.092088 Dec 15 16:14:27.881121 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 17/34] 10.222.0.30 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:27 2021] POST /compute/v2.1/flavors => generated 408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:27.893844 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-d202dbce-6b52-43f5-86a1-6c5294d94a15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:27.918533 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-d202dbce-6b52-43f5-86a1-6c5294d94a15 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028364 Dec 15 16:14:27.919117 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 18/35] 10.222.0.30 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:27 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:49.176236 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5b2826be-54d7-44c3-8d03-2cd0a86505a2 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:49.177284 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5b2826be-54d7-44c3-8d03-2cd0a86505a2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Dec 15 16:14:49.177698 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 18/36] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:14:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:49.249609 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-7a43c12b-8db4-4962-bf5d-2990a88980c8 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:49.267857 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-7a43c12b-8db4-4962-bf5d-2990a88980c8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.081714 Dec 15 16:14:49.268443 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 19/37] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Dec 15 16:14:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:50.896730 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5b2826be-54d7-44c3-8d03-2cd0a86505a2 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:50.897726 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5b2826be-54d7-44c3-8d03-2cd0a86505a2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Dec 15 16:14:50.898130 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 19/38] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:14:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:51.091755 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-c188e1f9-92fa-4c0f-8312-5b0f5f46e9d6 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:51.097682 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.wsgi [None req-c188e1f9-92fa-4c0f-8312-5b0f5f46e9d6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 16:14:51.098249 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-c188e1f9-92fa-4c0f-8312-5b0f5f46e9d6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:51.099042 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-c188e1f9-92fa-4c0f-8312-5b0f5f46e9d6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063054 Dec 15 16:14:51.099567 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 20/39] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Dec 15 16:14:51 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:51.109849 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-ee19d773-500f-47be-885b-ecb7557e34bb admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:51.132252 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-ee19d773-500f-47be-885b-ecb7557e34bb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025919 Dec 15 16:14:51.132852 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 20/40] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:51 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:51.143479 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-e23234df-171d-4de2-b3d6-ea94a25d2ed4 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:51.165744 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-e23234df-171d-4de2-b3d6-ea94a25d2ed4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025757 Dec 15 16:14:51.166205 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 21/41] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:51 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:51.177210 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-fb58d8f3-09f9-4554-a809-2822f4f6c5e2 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:51.182998 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-fb58d8f3-09f9-4554-a809-2822f4f6c5e2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 16:14:51.183584 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-fb58d8f3-09f9-4554-a809-2822f4f6c5e2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:51.184396 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-fb58d8f3-09f9-4554-a809-2822f4f6c5e2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011427 Dec 15 16:14:51.184974 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 21/42] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Dec 15 16:14:51 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:52.714004 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-e23234df-171d-4de2-b3d6-ea94a25d2ed4 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:52.715013 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-e23234df-171d-4de2-b3d6-ea94a25d2ed4 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 15 16:14:52.715410 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 22/43] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:14:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:52.917583 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-6712424f-3498-48f5-b264-4b05ce23c37e admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:52.924578 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-6712424f-3498-48f5-b264-4b05ce23c37e admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 16:14:52.925185 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-6712424f-3498-48f5-b264-4b05ce23c37e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:52.926009 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-6712424f-3498-48f5-b264-4b05ce23c37e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067048 Dec 15 16:14:52.926596 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 22/44] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Dec 15 16:14:52 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:52.937497 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-1e982776-19d7-4bd2-9d64-05475be4e745 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:52.953098 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-1e982776-19d7-4bd2-9d64-05475be4e745 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019254 Dec 15 16:14:52.953684 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 23/45] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:52.964896 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-78f0fab8-4403-4e99-80a0-d7ff36afcc93 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:52.979963 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-78f0fab8-4403-4e99-80a0-d7ff36afcc93 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018577 Dec 15 16:14:52.980588 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:52.991861 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-9a9a7ef3-1c25-461a-b236-09e346a047d6 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:52.997946 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.wsgi [None req-9a9a7ef3-1c25-461a-b236-09e346a047d6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 16:14:52.998559 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-9a9a7ef3-1c25-461a-b236-09e346a047d6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:52.999389 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-9a9a7ef3-1c25-461a-b236-09e346a047d6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011423 Dec 15 16:14:52.999955 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 24/47] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Dec 15 16:14:52 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:54.534462 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-78f0fab8-4403-4e99-80a0-d7ff36afcc93 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:54.535451 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-78f0fab8-4403-4e99-80a0-d7ff36afcc93 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Dec 15 16:14:54.535839 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 24/48] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:14:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:54.728449 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-768cd9fe-55cf-448a-9085-b89190117bbf admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:54.734299 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.wsgi [None req-768cd9fe-55cf-448a-9085-b89190117bbf admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 16:14:54.734856 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-768cd9fe-55cf-448a-9085-b89190117bbf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:54.735959 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-768cd9fe-55cf-448a-9085-b89190117bbf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062498 Dec 15 16:14:54.736561 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 25/49] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Dec 15 16:14:54 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:54.747136 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-6ea8ae9b-c7db-4d95-ab32-bdf46cd0470a admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:54.761900 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-6ea8ae9b-c7db-4d95-ab32-bdf46cd0470a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018406 Dec 15 16:14:54.762502 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 25/50] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:54.774540 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:54.788053 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018622 Dec 15 16:14:54.788672 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 26/51] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:54.799259 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-90a1570a-96cf-4503-b989-a09e8677f908 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:54.805192 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-90a1570a-96cf-4503-b989-a09e8677f908 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 16:14:54.805743 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-90a1570a-96cf-4503-b989-a09e8677f908 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:54.806554 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-90a1570a-96cf-4503-b989-a09e8677f908 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011126 Dec 15 16:14:54.807084 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 26/52] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Dec 15 16:14:54 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:56.357902 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:56.359030 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Dec 15 16:14:56.359478 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 27/53] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:14:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:56.559014 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-b607dfce-598c-4c91-9e30-d9e4074799b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:56.578803 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-b607dfce-598c-4c91-9e30-d9e4074799b6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.076541 Dec 15 16:14:56.579611 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 27/54] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Dec 15 16:14:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:58.119698 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:58.120886 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Dec 15 16:14:58.121289 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 28/55] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:14:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:58.320742 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-63f600ec-8845-4646-b963-be969a86bff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:58.345398 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-63f600ec-8845-4646-b963-be969a86bff6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080271 Dec 15 16:14:58.345869 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 28/56] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Dec 15 16:14:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:59.865907 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:59.866937 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Dec 15 16:14:59.867345 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 29/57] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:14:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:00.066180 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-0f6de897-61e0-4317-8567-e745faaf7b93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:00.093818 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-0f6de897-61e0-4317-8567-e745faaf7b93 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.084238 Dec 15 16:15:00.094815 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 29/58] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Dec 15 16:15:00 2021] POST /compute/v2.1/flavors => generated 407 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:15:01.585137 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:01.586164 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Dec 15 16:15:01.586587 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 30/59] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:15:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:01.798590 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-a82d798c-682e-4a3c-8720-71788894973d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:01.822110 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-a82d798c-682e-4a3c-8720-71788894973d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.096982 Dec 15 16:15:01.822683 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 30/60] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Dec 15 16:15:01 2021] POST /compute/v2.1/flavors => generated 409 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:15:03.379539 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:03.380629 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Dec 15 16:15:03.380997 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 31/61] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:15:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:03.596300 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-73e91dec-ca77-46e4-9218-3aff61cb2c41 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:03.617776 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-73e91dec-ca77-46e4-9218-3aff61cb2c41 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.086977 Dec 15 16:15:03.618353 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 31/62] 10.222.0.30 () {60 vars in 1202 bytes} [Wed Dec 15 16:15:03 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:52.437674 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:52.438665 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-31b9b995-30f3-4317-b950-d12f54461d8c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Dec 15 16:15:52.439065 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 32/63] 10.222.0.30 () {54 vars in 930 bytes} [Wed Dec 15 16:15:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:52.500603 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-456c9076-5288-4dc9-bce1-93655c9fb638 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:52.520376 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-456c9076-5288-4dc9-bce1-93655c9fb638 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074737 Dec 15 16:15:52.520952 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 32/64] 10.222.0.30 () {60 vars in 1291 bytes} [Wed Dec 15 16:15:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:52.543743 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-742d7b15-63cc-42c9-a06d-1ecb1fbe39c9 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:52.552207 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-742d7b15-63cc-42c9-a06d-1ecb1fbe39c9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012111 Dec 15 16:15:52.552785 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 33/65] 10.222.0.30 () {60 vars in 1282 bytes} [Wed Dec 15 16:15:52 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:52.565450 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-aa56e078-23d3-40a5-9081-77e4da66015d admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:52.573449 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-aa56e078-23d3-40a5-9081-77e4da66015d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011602 Dec 15 16:15:52.573977 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 33/66] 10.222.0.30 () {60 vars in 1285 bytes} [Wed Dec 15 16:15:52 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:52.586414 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-dbc1f9f8-906c-474c-a249-cac51b321ff4 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:52.595256 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-dbc1f9f8-906c-474c-a249-cac51b321ff4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012406 Dec 15 16:15:52.595829 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 34/67] 10.222.0.30 () {60 vars in 1285 bytes} [Wed Dec 15 16:15:52 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:52.608405 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:52.616994 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012095 Dec 15 16:15:52.617574 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 34/68] 10.222.0.30 () {60 vars in 1282 bytes} [Wed Dec 15 16:15:52 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:18.300061 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-e48d6962-cf71-4429-94a6-b4568c6a50f0 tempest-verify_tempest_config-902076973 tempest-verify_tempest_config-902076973-project] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:18.302126 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-e48d6962-cf71-4429-94a6-b4568c6a50f0 tempest-verify_tempest_config-902076973 tempest-verify_tempest_config-902076973-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.113792 Dec 15 16:17:18.302655 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 35/69] 10.222.0.30 () {58 vars in 1133 bytes} [Wed Dec 15 16:17:18 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:18:49.698916 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:49.699928 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 15 16:18:49.700329 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 35/70] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:18:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:49.981543 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-9e0b1730-fabc-479a-b446-f657712d01c2 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:49.982707 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:18:49.982707 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Dec 15 16:18:49.984355 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-9e0b1730-fabc-479a-b446-f657712d01c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:49.984824 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-9e0b1730-fabc-479a-b446-f657712d01c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:49.986561 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-9e0b1730-fabc-479a-b446-f657712d01c2 admin admin] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:49.987026 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-9e0b1730-fabc-479a-b446-f657712d01c2 admin admin] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:50.025758 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-9e0b1730-fabc-479a-b446-f657712d01c2 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.184872 Dec 15 16:18:50.026337 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 36/71] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Dec 15 16:18:49 2021] GET /compute/v2.1/os-services => generated 791 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:18:51.523727 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:51.524755 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Dec 15 16:18:51.525154 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 36/72] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:18:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:51.737476 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-b2624c74-71f6-4366-8c6d-3f92d50ef0aa admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:51.738674 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:18:51.738674 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Dec 15 16:18:51.740188 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-b2624c74-71f6-4366-8c6d-3f92d50ef0aa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:51.740716 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-b2624c74-71f6-4366-8c6d-3f92d50ef0aa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:51.741444 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-b2624c74-71f6-4366-8c6d-3f92d50ef0aa admin admin] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:51.746104 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-b2624c74-71f6-4366-8c6d-3f92d50ef0aa admin admin] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:51.761824 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-b2624c74-71f6-4366-8c6d-3f92d50ef0aa admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081362 Dec 15 16:18:51.762394 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 37/73] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Dec 15 16:18:51 2021] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:19:03.751838 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:03.752871 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Dec 15 16:19:03.753297 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 37/74] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:19:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:03.972499 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-51e7bba5-2d62-407c-8098-0e6ef8ddc2f9 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:03.974224 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:03.974224 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Dec 15 16:19:03.976952 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-51e7bba5-2d62-407c-8098-0e6ef8ddc2f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:03.977600 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-51e7bba5-2d62-407c-8098-0e6ef8ddc2f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:03.978818 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-51e7bba5-2d62-407c-8098-0e6ef8ddc2f9 admin admin] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:03.979408 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-51e7bba5-2d62-407c-8098-0e6ef8ddc2f9 admin admin] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:04.006066 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-51e7bba5-2d62-407c-8098-0e6ef8ddc2f9 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.109723 Dec 15 16:19:04.006632 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 38/75] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Dec 15 16:19:03 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:19:05.524685 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:05.525687 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-17884430-42b1-47da-93aa-e51ea438e460 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Dec 15 16:19:05.528540 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 38/76] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Dec 15 16:19:05 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:05.744955 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-1985b1c5-e2d6-48b4-b1bf-965617452697 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:05.746173 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:05.746173 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Dec 15 16:19:05.747787 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-1985b1c5-e2d6-48b4-b1bf-965617452697 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:05.748222 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-1985b1c5-e2d6-48b4-b1bf-965617452697 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:05.749028 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-1985b1c5-e2d6-48b4-b1bf-965617452697 admin admin] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:05.749525 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-1985b1c5-e2d6-48b4-b1bf-965617452697 admin admin] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:05.771612 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-1985b1c5-e2d6-48b4-b1bf-965617452697 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089939 Dec 15 16:19:05.772170 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 39/77] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Dec 15 16:19:05 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:20:03.931982 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: Wed Dec 15 16:20:03 2021 - graceful shutdown triggered... Dec 15 16:20:03.932589 dv-cinder-820027-2-iscsi devstack@n-api.service[101779]: Gracefully killing worker 2 (pid: 101779)... Dec 15 16:20:03.932972 dv-cinder-820027-2-iscsi devstack@n-api.service[101778]: Gracefully killing worker 1 (pid: 101778)... Dec 15 16:20:03.933701 dv-cinder-820027-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 16:20:04.932674 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: worker 1 buried after 1 seconds Dec 15 16:20:04.932674 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: worker 2 buried after 1 seconds Dec 15 16:20:04.932674 dv-cinder-820027-2-iscsi devstack@n-api.service[101777]: goodbye to uWSGI. Dec 15 16:20:04.934342 dv-cinder-820027-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 16:20:04.934925 dv-cinder-820027-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 16:20:04.937974 dv-cinder-820027-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 16:20:04.948095 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 16:20:04 2021] *** Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: nodename: dv-cinder-820027-2-iscsi Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: machine: x86_64 Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: clock source: unix Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: pcre jit disabled Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: detected number of CPU cores: 4 Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: current working directory: / Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: detected binary path: /usr/bin/uwsgi-core Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: your processes number limit is 47680 Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: your memory page size is 4096 bytes Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: detected max file descriptor number: 2048 Dec 15 16:20:04.957115 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: lock engine: pthread robust mutexes Dec 15 16:20:04.958436 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: thunder lock: enabled Dec 15 16:20:04.958436 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 16:20:04.958436 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 16:20:05.006931 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: Python main interpreter initialized at 0x556883cbb9c0 Dec 15 16:20:05.006931 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: python threads support enabled Dec 15 16:20:05.006931 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: your server socket listen backlog is limited to 100 connections Dec 15 16:20:05.006931 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: your mercy for graceful operations on workers is 90 seconds Dec 15 16:20:05.007380 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 16:20:05.007380 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: *** Operational MODE: preforking *** Dec 15 16:20:05.007685 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: *** uWSGI is running in multiple interpreter mode *** Dec 15 16:20:05.007685 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: spawned uWSGI master process (pid: 116001) Dec 15 16:20:05.007943 dv-cinder-820027-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 16:20:05.008632 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: spawned uWSGI worker 1 (pid: 116021, cores: 1) Dec 15 16:20:05.009163 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: spawned uWSGI worker 2 (pid: 116022, cores: 1) Dec 15 16:20:05.009438 dv-cinder-820027-2-iscsi devstack@n-api.service[116001]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 16:20:06.920111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:20:06.920111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: from cryptography.utils import int_from_bytes Dec 15 16:20:06.920925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:20:06.920925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: from cryptography.utils import int_from_bytes Dec 15 16:20:06.930859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:20:06.930859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: from cryptography.utils import int_from_bytes Dec 15 16:20:06.931506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:20:06.931506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: from cryptography.utils import int_from_bytes Dec 15 16:20:09.385538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:20:09.386081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:20:09.386178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:20:09.386557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:20:09.386814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:20:09.387204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.387528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.387852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.388181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.388535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.388850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.389171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.389495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.389825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.390076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.390412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.390823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-2-iscsi {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.391116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.391504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.391739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.392059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.392348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.392706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.393017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.393522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.393997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.394310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.394627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.394970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.395268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.395600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.395923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.396236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.396589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.397080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.397524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-2-iscsi {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.397847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.398168 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.398485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.398906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.399218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.399537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.399860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.400183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.400703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.401205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.401514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.401841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.402195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.402473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.402828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.403095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.403430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.403739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.404034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.404287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.404629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.404955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.405278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.405600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.405853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.406103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.406670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.406970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.407282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.407595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.407906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.408214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.408555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.408868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.409178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.409487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.409808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.410128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.410448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.410771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.411081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.411487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.411740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.412049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.412394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.412743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.413060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.413382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.413702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.414037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.414328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.414646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.414967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.415305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.415609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.415860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.416163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.416496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.416820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.417125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.417435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.417743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.418045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.418352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.418660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.418966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.419272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.419585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.419892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.420200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.420538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.420850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.421169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.421532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.421809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.422136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.422443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.422809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.423062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.423371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.424303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.424303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.424303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.424868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.425024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.425225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.425533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.425856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.426156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.426463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.426782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.427087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.427575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.427886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.428194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.428535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.428846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.429152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.429466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.429760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.430076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.430443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.430740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.431045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.431356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.431644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.432018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.432347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.432783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.433013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.433373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.433679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.434026 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.434319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.434662 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.434988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.435287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.435598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.435913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.436232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.436574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.436908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.437225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.437571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.437999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.438337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.438638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.438968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.439292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.439606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.439952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.440291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.440633 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.440965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.441260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.441583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.441915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.442210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.442522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.442853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.443164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.443477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.443815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.444134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.444473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.444786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.445090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.445395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.445707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.446012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.446335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.446665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.446972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.447311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.447619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.447932 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.448243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.448572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.448934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.449198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.449503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.449829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.450141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.450442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.450773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.451072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.451377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.451692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.452005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.452316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.452648 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.452977 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.453314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.453625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.453960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.454296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.454601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.454925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.455249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.455567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.455871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.456182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.456506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.456811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.457115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.457426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.457731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.458034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.458336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.458654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.458936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.459256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.459567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.459870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.460238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.460491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.460936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.461213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.461467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.461805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.462125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.462451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.462762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.463088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.463395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.463708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.464024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.464334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.464681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.464994 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.465310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.465623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.465941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.466253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.466574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.466878 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.467195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.467534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.467865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.468181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.468535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.468901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.469217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.469529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.469839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.470149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.470460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.470614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:20:09.471246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:20:09.471473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.471473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.471773 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:20:09.471936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.472100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:20:09.472249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.472390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:20:09.472652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.472807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.472958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.473125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.473425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.473575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.473722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.473872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.474027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.474027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.474403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.474403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.474679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.474679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.474964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.475227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.475381 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.475530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.475671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.475671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.476307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.476495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.476653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.476653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.476928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-2-iscsi {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.477076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.477234 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.477382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.477529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.477669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.477823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.477974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.478123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.478274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.478422 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.478562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.478702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.478873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.479094 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.479251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.479393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.479553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.479710 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.479865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.480030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.480171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.480313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.480638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.480638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.480926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.481080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.481245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.482388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.482554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.482793 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.482951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.483101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.483262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.483507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.483663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.483812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.483964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.484113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.484920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-2-iscsi {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.485088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.485260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.485490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.485645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.485806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.485955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.486117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.486265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.486417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.486568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.486708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.486856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.487004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.487153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.487308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.487308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.487308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.487720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.487879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.488028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.488177 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.488325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.488514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.488672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.488814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.488963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.489127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.489345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.489500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.489641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.489789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.489950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.490097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.490097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.490380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.490520 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.490759 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.491005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.491151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.491292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.491432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.491432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.491825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.491982 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.492149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.492290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.492570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.492570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.492953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.492953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.492953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.493365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.493524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.493749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.493906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.494067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.494207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.494356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.494590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.494745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.494894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.495036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.495179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.495318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.495486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.495707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.495852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.496001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.496161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.496302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.496492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.497565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.497718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.497872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.498023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.498172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.498328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.498470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.498611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.498750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.498890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.499049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.499200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.499360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.499360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.499702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.499702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.499967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.499967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.500452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.500601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.500742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.502573 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.502860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.503122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.503270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.503430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.503591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.503760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.503985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.504129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.504278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.504487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.504745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.504892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.505035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.505195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.505348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.505594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.505844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.505999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.506148 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.506290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.506440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.506597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.506739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.506906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.506906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.506906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.507962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.508119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.508261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.508401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.508576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.508728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.508869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.509022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.509172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.509319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.509460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.509706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.509866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.510025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.510167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.510306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.510445 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.510584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.510738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.510880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.511019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.511159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.511307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.511461 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.511611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.511770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.511919 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.512060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.512199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.512367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.512650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.512900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.513158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.513379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.513525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.513676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.513827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.513986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.514220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.514365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.514506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.514655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.514892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.515040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.515195 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.515344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.515492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.515633 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.515775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.516005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.516213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.516378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.516594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.516756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.516909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.517067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.517215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.517357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.517498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.517638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.517785 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.517943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.518086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.518234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.518386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.518527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.518667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.518891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.518891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.519169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.519318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.519458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.519607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.519854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.520001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.520143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.520290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.520460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.520733 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.520879 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.521020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.521168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.521310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.521450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.521604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.521753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.521895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.522044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.522185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.522345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.522501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.522667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.522918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.523184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.523544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.523692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.523849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.523992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:09.524141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.524141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.524141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.524684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.524863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.525096 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.525242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.525400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.525542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.525697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.525839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.525999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.526226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.526226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.526501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.526661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.526810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.526962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.527103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.527103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.527391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.527391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.527670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.527810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.527949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.528096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.528246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.528388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.528552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.528705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.528845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.528996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.529145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.529295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.529436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.529586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.529727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.529885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.530110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.530254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.530420 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.530757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.530923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.531067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.531218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.531497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.535572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.535751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.535905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.536074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.536238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.536494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.536646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.536797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.536941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.537106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.537106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.537378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.537526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.537676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.537826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.537978 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.538120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.538268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.538410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.538551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.538692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.538846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.539004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.539147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.539295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.539437 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.539587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.539728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.539876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.540027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.540276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.540447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.540608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.540758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.540909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.541052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.541192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.541341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.541495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.541637 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.541779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.541918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.542059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.542200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.542350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.543036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.543208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.543375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.543527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.543682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.543914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.543914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.544194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.544194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.544554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.544554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.544554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.544554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.545126 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.545790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.545963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.546117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.546259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.546401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.546630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.546784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.546966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.547122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.547265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.547265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.547543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.547691 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.547851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.548011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.548158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.548305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.548470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.548470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.548773 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.548930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.549079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.549294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.549473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.549706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.549871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.550031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.550186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.550455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.550610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.550764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.550926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.551082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.551236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.551385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.551532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.551688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.551845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.552002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.552168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.552323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.552519 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.552688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.552838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.552838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.553129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.553282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.553436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.553659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.553810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.553810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.554104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.554270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.554417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.554417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.554717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.554864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.555084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.555233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.555412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.555412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.556310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.556310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.556856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.557017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.557181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.557331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.557486 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.557644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.557792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.557939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.558096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.558246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.558401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.558552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.558700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.558846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.559018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.559167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.559321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.559469 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.559623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.559784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.559941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.560090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.560090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.560383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.560645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.561021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.561178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.561400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.561551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.561707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.561707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.561707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.562143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.562292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.562438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.562732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.562891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.563050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.563206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.563365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.563575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.563736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.563893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.564042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.564190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.564344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.564560 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.564723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.564723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.565016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.565164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.565311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.565459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.566245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.566418 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.566568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.566735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.566962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.567116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.567277 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.567502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.567661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.567817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.567965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.568120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.568292 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.568467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.568623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.568781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.568930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.569076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.569237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.569394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.569551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.569705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.569853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.570005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.570161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.570328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.570477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.570641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.570872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.571025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.571182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.571330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.571479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.571626 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.571784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.571941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.572090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.572237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.572403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.572625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.572844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.573010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.573165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.573314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.573468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.573618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.573765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.573924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.575173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.575341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.575501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.575693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.575957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.576573 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.576741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.576891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.577127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.577282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.577444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.577593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.577750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.577897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.578941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.579943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.580923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581626 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.581997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.582979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.583991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584689 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.584934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585012 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.585843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.586102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.586202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.586202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.586812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.586890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.586962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.586962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.586962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.587948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.588980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589721 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589721 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.589936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.590961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.591932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.592964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593760 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.593945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.594837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.595957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.596205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.596299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.596694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.596980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.596980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.597129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.597202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.597274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.597518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.597608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.597737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.597828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.598044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.598131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.598356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.598437 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.598742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.598849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.598975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.599056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.599282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.599372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.599588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.599676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.599900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.599979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.600205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.600285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.602166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.602318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.602318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.602621 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.602621 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.602910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.603070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.603218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.603364 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.603519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.603666 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.603819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.603979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.604128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.604283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.604502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.604667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.604667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.605015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.605172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.605329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.605476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.605631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.605793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.605957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.606210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.606502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.606865 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.607057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.607394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.607559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.607708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.607863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.608019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.608176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.608339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.608514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.608666 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.608831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.609057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.609211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.609485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.609649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.609799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.609954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.610102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.610264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.610413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.610560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.610708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.610854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.611010 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.611177 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.611341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.611488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.611644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.611800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.611800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.612090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.612090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.612370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.612555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.612665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.612785 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.612879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.612968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613421 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613421 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.613833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.614138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.614225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.614546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.614700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.614855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.615003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.615150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.615368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.615529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.615693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.616075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.616566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.616962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.617938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.618100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.618260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.618417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.618574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.618731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.618891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.619059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.619289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.619442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.619591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.619739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.619913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.620070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.620070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.620363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.620533 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.620713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.621003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.621186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.621376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.621557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.621754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.621946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.622139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.622319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.622518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.622709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.622901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.623096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.623286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.623467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.623657 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.623838 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.623838 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.624275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.624477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.624683 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.624865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.625097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.625097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.625468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.625468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.626656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.626656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.627283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.627478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.627661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.628184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.628425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.628634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.628787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.628787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.629095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.629512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.629676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.629827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.629985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.630146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.630146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.630438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.630595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.630767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.630939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.631089 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.631246 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.631394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.631548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.631702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.631860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.632015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.632174 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.632325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.632537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.632706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.632876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.633033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.633189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.633338 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.633485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.633642 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.633798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.633955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.634104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.634252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.634407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.634569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.634729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.634729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.635009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.635157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.635319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.635484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.635688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.635854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.636012 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.636160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.636317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.636502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.636814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.637005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.637401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.637401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.637703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.637852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.638000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.638356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.639133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.639298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.639456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.639699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.639890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.640302 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.640528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.640717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.640867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.640867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:20:09.641159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.641159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.641159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.641159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.641159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.641159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.641159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.641159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.642286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.642286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.642286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.642286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.642286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.642286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.642286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.642286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.643382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.643382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.643382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.643382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.643382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.643382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.643382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.643382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.644546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.644546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.644546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.644546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.644546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.644546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.645402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.645402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.645402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.645842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.646049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.646380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.646917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.647082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.647518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.647673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.648002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.648527 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.648692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.649012 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.649394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.649640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.649960 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.650276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.650577 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.650890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.651210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.651522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.651849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.652299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.653654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.653654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.653654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.653911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.653988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.654396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.654602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.654961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.655274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.655616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.655946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.656422 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.657436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.657758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.658103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.658431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.658755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.658949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:09.659082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.659407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.659731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.660055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.660381 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.660725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.661051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.661372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.661697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.662281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.662615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.662936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.663257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.663584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.663901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.664222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.664573 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.664893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.665211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.665530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.665864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.666193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.666523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.666866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.667192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.667514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.667835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.668155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.668540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.668876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.669171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.669491 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.669813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.670135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.670451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.670767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.671086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.671403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.671721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.672072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.672952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.673280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.673614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.673957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.674295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.674607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.674927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.675263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.676415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.676415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.676415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.676773 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.677208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.677433 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.677835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.678087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.678400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.678711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.679038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.679339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.679798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.680128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.680461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.680780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.681107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.681424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.681981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.682343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.682670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.683002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.683334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.683657 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.683970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.684301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.684755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.685070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.685392 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.685714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.686026 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.686338 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.686657 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.686975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.687286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.687658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.688539 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.688890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.689216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.689535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.689993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.690168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.690484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.690800 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.691116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.691431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.691755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.692067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.692390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.692729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.693051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.693363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.693682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.693994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.694327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.694639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.694951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.695282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.695603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.695935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.696257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.696600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.696959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.697376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.697853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.698235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.698568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.698916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.699265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.699582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.699913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.700209 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.700564 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.700887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.701211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.701525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.701844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.702177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.702495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.702814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.703155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.703606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.703928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.704280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.704640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.704959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.705287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.705613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.705932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.706251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.706568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.706884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.707206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.707609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.707862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.708176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.708634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.708957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.709287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.709615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.709981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.710265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.710592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.710923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.711239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.711559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.711894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.712244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.712602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.712933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.713247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.713559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.713870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.714188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.714525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.714863 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.715186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.715518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.715835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.716164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.716500 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.716833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.717161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.717481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.717804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.718618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.718618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.718877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.719599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.719923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.720324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.720595 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.720997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.721261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.721577 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.721908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.722239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.722571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.722892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.723208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.723545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.723864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.724184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.724526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.724848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.725170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.725494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.725825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.726355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.context [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),144f1872-fd4a-4f70-bcac-e90acefa618e(cell1) {{(pid=116021) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:20:09.726520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.726854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.727187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.727541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.727859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.728213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.728570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.728891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.729207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.729518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:09.729763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:20:09.730680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:09.732279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:09.733104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:09.735097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:09.747662 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:09.748528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:09.760514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_db.sqlalchemy.engines [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:09.825483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.context [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),144f1872-fd4a-4f70-bcac-e90acefa618e(cell1) {{(pid=116022) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:20:09.830162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:09.831745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:09.832592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:09.834578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:09.847430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_db.sqlalchemy.engines [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:09.848262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_db.sqlalchemy.engines [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:09.909303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:10.011106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_db.sqlalchemy.engines [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:10.228203 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: WARNING keystonemiddleware.auth_token [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:20:10.235167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: WARNING keystonemiddleware.auth_token [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:20:10.335490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: WARNING keystonemiddleware.auth_token [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:20:10.342686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: WARNING keystonemiddleware.auth_token [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:20:10.590967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: WARNING keystonemiddleware.auth_token [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:20:10.597152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: WARNING keystonemiddleware.auth_token [None req-c3d3a0c2-d2ec-4f39-beb8-20d4910321e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:20:10.603282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556883cbb9c0 pid: 116021 (default app) Dec 15 16:20:10.713805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: WARNING keystonemiddleware.auth_token [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:20:10.719890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: WARNING keystonemiddleware.auth_token [None req-36eaa924-6c2f-4eda-8b1b-0795c5113a0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:20:10.726442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556883cbb9c0 pid: 116022 (default app) Dec 15 16:20:43.970984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b253815a-b8b3-4c12-acb0-41d283ed8464 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Action: 'create', calling method: .version_select at 0x7f3a7e0a8ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1152109960"}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:45.703223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b253815a-b8b3-4c12-acb0-41d283ed8464 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.773854 Dec 15 16:20:45.704030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1154 bytes} [Wed Dec 15 16:20:42 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2776 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 16:20:45.717742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-50cd17ed-954f-41b7-81bf-d9e233689388 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7df8ca60>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:45.802179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-50cd17ed-954f-41b7-81bf-d9e233689388 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66" status: 200 len: 345 microversion: 2.1 time: 0.089379 Dec 15 16:20:45.803471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 2/2] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:45 2021] GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:46.549492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c5015fde-8f3f-4d52-b08d-acc3703d6724 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Action: 'create', calling method: .version_select at 0x7f3a7e0b7e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1930456197", "metadata": {"Type": "work"}}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:46.815968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-32c4aeb8-f65a-47d1-b04d-de63bc32d11c tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7df8cdc0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:46.960668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-32c4aeb8-f65a-47d1-b04d-de63bc32d11c tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66" status: 200 len: 346 microversion: 2.1 time: 0.149141 Dec 15 16:20:46.961632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 3/3] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:46 2021] GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 => generated 346 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:20:46.973650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-101c81d0-4e6b-4e30-bbf3-b8076a9b96a6 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Action: 'create', calling method: .version_select at 0x7f3a7df9f430>, body: {"snapshot": {"volume_id": "79f0e9b9-f2b3-4f64-9ee2-604802ebfe66", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1230305191"}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:47.604066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-101c81d0-4e6b-4e30-bbf3-b8076a9b96a6 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.635169 Dec 15 16:20:47.612677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 4/4] 10.222.0.30 () {60 vars in 1161 bytes} [Wed Dec 15 16:20:46 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:20:47.619461 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7970493a-4f8e-4fe3-903a-668e87515fae tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7df2b040>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:48.108274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7970493a-4f8e-4fe3-903a-668e87515fae tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040" status: 200 len: 287 microversion: 2.1 time: 0.494023 Dec 15 16:20:48.114622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 5/5] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Dec 15 16:20:47 2021] GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040 => generated 287 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:48.255445 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c5015fde-8f3f-4d52-b08d-acc3703d6724 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.106466 Dec 15 16:20:48.258008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1/6] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Dec 15 16:20:45 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3111 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 15 16:20:48.270125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1134915654", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "networks": [{"uuid": "9574d140-c5c8-46bb-a2bf-43638c2893c8"}]}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:48.284314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3d5f7c4a-e97a-49d3-9c1b-822f0026638e tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7df899d0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:48.407536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3d5f7c4a-e97a-49d3-9c1b-822f0026638e tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/97396ce2-4f7a-4461-a6f6-6403804b32bf" status: 200 len: 350 microversion: 2.1 time: 0.131855 Dec 15 16:20:48.408869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 2/7] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:48 2021] GET /compute/v2.1/os-volumes/97396ce2-4f7a-4461-a6f6-6403804b32bf => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:48.430634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0f464d9d-efa9-4134-9cf2-a671e13fc4c8 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7df89ee0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:48.434936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.network.neutron [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] validate_networks() for [('9574d140-c5c8-46bb-a2bf-43638c2893c8', None, None, None, None, None)] {{(pid=116021) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:20:48.504943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0f464d9d-efa9-4134-9cf2-a671e13fc4c8 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.094515 Dec 15 16:20:48.507481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 3/8] 10.222.0.30 () {58 vars in 1139 bytes} [Wed Dec 15 16:20:48 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:48.514416 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c919ecbd-82b8-40a2-b2cf-3beda1793a41 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Calling method '.version_select at 0x7f3a7dfa09d0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:48.717327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c919ecbd-82b8-40a2-b2cf-3beda1793a41 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238" status: 200 len: 353 microversion: 2.1 time: 0.208162 Dec 15 16:20:48.718029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 4/9] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:48 2021] GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238 => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:48.723664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fe04560e-ed82-4b3a-852f-95160b6e125e tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7df25280>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:48.785460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fe04560e-ed82-4b3a-852f-95160b6e125e tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040" status: 200 len: 287 microversion: 2.1 time: 0.065953 Dec 15 16:20:48.790473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 5/10] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Dec 15 16:20:48 2021] GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:49.736786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9e20a92b-59aa-417e-8ce9-d681759522d6 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Calling method '.version_select at 0x7f3a7dfa0ee0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:49.800871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9e20a92b-59aa-417e-8ce9-d681759522d6 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238" status: 200 len: 353 microversion: 2.1 time: 0.068434 Dec 15 16:20:49.802233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:49 2021] GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:20:49.814705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-817e629f-271b-45c0-8d8f-b184b532db40 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7dfa0670>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:49.854615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-817e629f-271b-45c0-8d8f-b184b532db40 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040" status: 200 len: 287 microversion: 2.1 time: 0.050969 Dec 15 16:20:49.855197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 7/12] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Dec 15 16:20:49 2021] GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:50.280047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Flavor limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:20:50.284696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Image limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:20:50.289790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Flavor pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:20:50.293735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Image pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:20:50.294983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:20:50.323392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:50.324462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:50.326294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:50.327287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:50.393768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Getting quotas for project 0d66ed76bcb74b45acc60dc6a0c965f1. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:20:50.405953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Getting quotas for user 7221014c51874578aaaf6f78e5327d70 and project 0d66ed76bcb74b45acc60dc6a0c965f1. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:20:50.425321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Going to run 1 instances... {{(pid=116021) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:20:50.431185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:20:50.575656 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-98897177-ab45-49cb-a767-69dedf99a21b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.459079 Dec 15 16:20:50.577057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 6/13] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:20:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:20:50.588639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dbb118a2-f7d1-4d60-ba97-2cb5137f425f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:50.589967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dbb118a2-f7d1-4d60-ba97-2cb5137f425f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:50.706454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dbb118a2-f7d1-4d60-ba97-2cb5137f425f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:50.748368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dbb118a2-f7d1-4d60-ba97-2cb5137f425f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1215 microversion: 2.1 time: 0.164342 Dec 15 16:20:50.749114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 8/14] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:50 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:50.819031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a2019384-405b-4d2c-bb4c-4bbc2b6d4301 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Calling method '.version_select at 0x7f3a7d625310>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:50.867226 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9af9fd7d-4347-4459-afef-3ff7d2e49be2 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7df25550>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:50.916887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a2019384-405b-4d2c-bb4c-4bbc2b6d4301 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238" status: 200 len: 353 microversion: 2.1 time: 0.102935 Dec 15 16:20:50.917473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 7/15] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:50 2021] GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:20:50.931005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9af9fd7d-4347-4459-afef-3ff7d2e49be2 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040" status: 200 len: 287 microversion: 2.1 time: 0.068342 Dec 15 16:20:50.931746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 9/16] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Dec 15 16:20:50 2021] GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:20:51.777069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c58d113c-56a9-4b8a-804b-9c5f87806c2f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:51.778016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c58d113c-56a9-4b8a-804b-9c5f87806c2f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:51.884334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c58d113c-56a9-4b8a-804b-9c5f87806c2f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:51.911226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c58d113c-56a9-4b8a-804b-9c5f87806c2f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1215 microversion: 2.1 time: 0.137722 Dec 15 16:20:51.929793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a57a71a4-da36-40ee-8864-b4b1a0503f30 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Calling method '.version_select at 0x7f3a7df60940>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:51.935653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 8/17] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:51 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:51.954871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5f4d6793-c6c4-41e3-bc80-ef70251100cb tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7d645dc0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:52.008358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a57a71a4-da36-40ee-8864-b4b1a0503f30 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238" status: 200 len: 354 microversion: 2.1 time: 0.082090 Dec 15 16:20:52.009732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 10/18] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:51 2021] GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:52.023029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-76c2677f-7749-4c61-8be2-a209a2844d30 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Calling method '.version_select at 0x7f3a7def0310>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:52.055407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5f4d6793-c6c4-41e3-bc80-ef70251100cb tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040" status: 200 len: 288 microversion: 2.1 time: 0.115897 Dec 15 16:20:52.056291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 9/19] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Dec 15 16:20:51 2021] GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040 => generated 288 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:52.072115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-35419d1e-6a21-4050-8396-80635270b6f1 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7cdeb0d0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:52.185761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-76c2677f-7749-4c61-8be2-a209a2844d30 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238" status: 200 len: 354 microversion: 2.1 time: 0.166832 Dec 15 16:20:52.186354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 11/20] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:52 2021] GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238 => generated 354 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:20:52.205036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3bda384f-237d-48ee-b835-43a4b95579cb tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Calling method '.version_select at 0x7f3a7df60ee0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:52.370835 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-35419d1e-6a21-4050-8396-80635270b6f1 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040" status: 202 len: 0 microversion: 2.1 time: 0.302423 Dec 15 16:20:52.373533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 10/21] 10.222.0.30 () {58 vars in 1253 bytes} [Wed Dec 15 16:20:52 2021] DELETE /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:20:52.388201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b23adba0-262f-41eb-acba-ec2dffe9e468 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7d651dc0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:52.683782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3bda384f-237d-48ee-b835-43a4b95579cb tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238" status: 202 len: 0 microversion: 2.1 time: 0.482952 Dec 15 16:20:52.684976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 12/22] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Dec 15 16:20:52 2021] DELETE /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:20:52.690573 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b4aade43-b080-4431-b8c1-270dea42e897 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7df60820>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:52.699916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b23adba0-262f-41eb-acba-ec2dffe9e468 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040" status: 200 len: 287 microversion: 2.1 time: 0.319186 Dec 15 16:20:52.700844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Dec 15 16:20:52 2021] GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040 => generated 287 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:52.706120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d4ae7389-6ef2-49a2-adef-fda7ed6e5168 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Calling method '.version_select at 0x7f3a7cdeb670>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:52.860763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b4aade43-b080-4431-b8c1-270dea42e897 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a6fe5248-1469-421e-a84b-67e34a56a143" status: 200 len: 350 microversion: 2.1 time: 0.174237 Dec 15 16:20:52.862424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 13/24] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:52 2021] GET /compute/v2.1/os-volumes/a6fe5248-1469-421e-a84b-67e34a56a143 => generated 350 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:52.940482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7b8e593a-e5d7-4836-9816-ccb3b7c7da81 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:52.941715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7b8e593a-e5d7-4836-9816-ccb3b7c7da81 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:53.034506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d4ae7389-6ef2-49a2-adef-fda7ed6e5168 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238" status: 200 len: 353 microversion: 2.1 time: 0.332175 Dec 15 16:20:53.035526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 12/25] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:52 2021] GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238 => generated 353 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:53.135867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7b8e593a-e5d7-4836-9816-ccb3b7c7da81 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:53.152404 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7b8e593a-e5d7-4836-9816-ccb3b7c7da81 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1215 microversion: 2.1 time: 0.216413 Dec 15 16:20:53.165067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 14/26] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:52 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:20:53.717529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f8225da2-56af-4997-b3fe-7a6dc43416dd tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7cdeb940>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:53.812948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-f8225da2-56af-4997-b3fe-7a6dc43416dd tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] HTTP exception thrown: Snapshot 5c0eedfc-4536-4c64-99ef-ca99e40db040 could not be found. Dec 15 16:20:53.814361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f8225da2-56af-4997-b3fe-7a6dc43416dd tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Returning 404 to user: Snapshot 5c0eedfc-4536-4c64-99ef-ca99e40db040 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:20:53.816138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f8225da2-56af-4997-b3fe-7a6dc43416dd tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040" status: 404 len: 111 microversion: 2.1 time: 0.104722 Dec 15 16:20:53.831264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 13/27] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Dec 15 16:20:53 2021] GET /compute/v2.1/os-snapshots/5c0eedfc-4536-4c64-99ef-ca99e40db040 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:20:53.835433 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9e90267e-c956-4aec-b259-2451370922f1 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7def0820>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:53.995788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9e90267e-c956-4aec-b259-2451370922f1 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66" status: 202 len: 0 microversion: 2.1 time: 0.170272 Dec 15 16:20:53.997091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 15/28] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Dec 15 16:20:53 2021] DELETE /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:20:54.008956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4ebb57e5-0272-4aa2-abeb-26c97b2beeb9 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7cdeb8b0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:54.057163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2e759113-b1b4-4aa4-b9bb-ae09ccb49a77 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Calling method '.version_select at 0x7f3a7df603a0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:54.110033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4ebb57e5-0272-4aa2-abeb-26c97b2beeb9 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66" status: 200 len: 345 microversion: 2.1 time: 0.108156 Dec 15 16:20:54.116293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 14/29] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:54 2021] GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:54.150427 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-2e759113-b1b4-4aa4-b9bb-ae09ccb49a77 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] HTTP exception thrown: Volume b11b6c13-2149-49d9-a450-fae7bdac0238 could not be found. Dec 15 16:20:54.152193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2e759113-b1b4-4aa4-b9bb-ae09ccb49a77 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] Returning 404 to user: Volume b11b6c13-2149-49d9-a450-fae7bdac0238 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:20:54.153424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2e759113-b1b4-4aa4-b9bb-ae09ccb49a77 tempest-VolumesGetTestJSON-147797920 tempest-VolumesGetTestJSON-147797920-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238" status: 404 len: 109 microversion: 2.1 time: 0.106674 Dec 15 16:20:54.154229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 16/30] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:54 2021] GET /compute/v2.1/os-volumes/b11b6c13-2149-49d9-a450-fae7bdac0238 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:20:54.193435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7f7de450-21bc-472b-81de-201eb7fc58a6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:54.194285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7f7de450-21bc-472b-81de-201eb7fc58a6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:54.207679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f7de450-21bc-472b-81de-201eb7fc58a6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:54.210429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f7de450-21bc-472b-81de-201eb7fc58a6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:54.215184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f7de450-21bc-472b-81de-201eb7fc58a6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:54.217178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f7de450-21bc-472b-81de-201eb7fc58a6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:55.060616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7f7de450-21bc-472b-81de-201eb7fc58a6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:55.089685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7f7de450-21bc-472b-81de-201eb7fc58a6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1267 microversion: 2.1 time: 0.900306 Dec 15 16:20:55.090289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 15/31] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:54 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1267 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:55.111828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1dc008a6-f172-4f3d-9f2f-e9b08ad0475a tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7df609d0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:55.124105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c9509d20-c94c-471e-a0f2-75b09035e96c tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7cd98e50>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:55.253119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1dc008a6-f172-4f3d-9f2f-e9b08ad0475a tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a13636e5-a34c-4784-8f0c-bc75799a70ae" status: 200 len: 351 microversion: 2.1 time: 0.152569 Dec 15 16:20:55.267476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 17/32] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:55 2021] GET /compute/v2.1/os-volumes/a13636e5-a34c-4784-8f0c-bc75799a70ae => generated 351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:55.289973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2d0644b7-871c-41da-9e2a-4a35088bfd88 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7def0820>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:55.608756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-c9509d20-c94c-471e-a0f2-75b09035e96c tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] HTTP exception thrown: Volume 79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 could not be found. Dec 15 16:20:55.609378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c9509d20-c94c-471e-a0f2-75b09035e96c tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Returning 404 to user: Volume 79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:20:55.610844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c9509d20-c94c-471e-a0f2-75b09035e96c tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66" status: 404 len: 109 microversion: 2.1 time: 0.490198 Dec 15 16:20:55.612501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 16/33] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:55 2021] GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 => generated 109 bytes in 493 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:20:55.641904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-54c28ac6-511a-429b-b256-0d4ecf148a11 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7d625a60>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:55.915367 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2d0644b7-871c-41da-9e2a-4a35088bfd88 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.645739 Dec 15 16:20:55.916509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 18/34] 10.222.0.30 () {58 vars in 1133 bytes} [Wed Dec 15 16:20:55 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:55.944399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-040eaf2e-41b4-49ff-a145-28ef5f64e779 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7def0c10>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:56.018384 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-54c28ac6-511a-429b-b256-0d4ecf148a11 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] HTTP exception thrown: Volume 79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 could not be found. Dec 15 16:20:56.019093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-54c28ac6-511a-429b-b256-0d4ecf148a11 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Returning 404 to user: Volume 79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:20:56.020343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-54c28ac6-511a-429b-b256-0d4ecf148a11 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66" status: 404 len: 109 microversion: 2.1 time: 0.387935 Dec 15 16:20:56.021925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 17/35] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Dec 15 16:20:55 2021] DELETE /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 => generated 109 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:20:56.038280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b28f92c7-a3d8-4292-a319-55b973fa1538 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Calling method '.version_select at 0x7f3a7cd988b0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:56.292776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-040eaf2e-41b4-49ff-a145-28ef5f64e779 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.359906 Dec 15 16:20:56.293591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-b28f92c7-a3d8-4292-a319-55b973fa1538 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] HTTP exception thrown: Volume 79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 could not be found. Dec 15 16:20:56.294196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b28f92c7-a3d8-4292-a319-55b973fa1538 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] Returning 404 to user: Volume 79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:20:56.295007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b28f92c7-a3d8-4292-a319-55b973fa1538 tempest-VolumesSnapshotsTestJSON-2017097735 tempest-VolumesSnapshotsTestJSON-2017097735-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66" status: 404 len: 109 microversion: 2.1 time: 0.268056 Dec 15 16:20:56.295419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 19/36] 10.222.0.30 () {58 vars in 1148 bytes} [Wed Dec 15 16:20:55 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:56.297334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 18/37] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:20:56 2021] GET /compute/v2.1/os-volumes/79f0e9b9-f2b3-4f64-9ee2-604802ebfe66 => generated 109 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:20:56.325764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-732fd4ed-268c-4ce7-a6b6-acab522b3aca tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:56.331440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2f4d7f52-8d44-476e-93b3-0ed47637e3b4 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7cd98dc0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:56.332698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-732fd4ed-268c-4ce7-a6b6-acab522b3aca tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:56.405679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-732fd4ed-268c-4ce7-a6b6-acab522b3aca tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:56.406478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-732fd4ed-268c-4ce7-a6b6-acab522b3aca tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:56.415956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-732fd4ed-268c-4ce7-a6b6-acab522b3aca tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:56.422526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-732fd4ed-268c-4ce7-a6b6-acab522b3aca tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:56.486710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2f4d7f52-8d44-476e-93b3-0ed47637e3b4 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.180664 Dec 15 16:20:56.488467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 19/38] 10.222.0.30 () {58 vars in 1133 bytes} [Wed Dec 15 16:20:56 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:56.502365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9747fce2-fe4d-4707-83f1-410a84d957c5 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7d645b80>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:56.800052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9747fce2-fe4d-4707-83f1-410a84d957c5 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.303761 Dec 15 16:20:56.800677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 20/39] 10.222.0.30 () {58 vars in 1166 bytes} [Wed Dec 15 16:20:56 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:20:56.813328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3bf3a01c-b5ad-49fa-97f1-39515dc11c8e tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7cd25d30>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:57.041643 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3bf3a01c-b5ad-49fa-97f1-39515dc11c8e tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.232743 Dec 15 16:20:57.049977 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 21/40] 10.222.0.30 () {58 vars in 1169 bytes} [Wed Dec 15 16:20:56 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:57.055551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-750fafa9-fcd3-418e-b3bd-01510291c65d tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7cd25af0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:57.136824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-732fd4ed-268c-4ce7-a6b6-acab522b3aca tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:57.219382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-732fd4ed-268c-4ce7-a6b6-acab522b3aca tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1273 microversion: 2.1 time: 0.919846 Dec 15 16:20:57.220595 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 20/41] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:56 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1273 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:57.298250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-750fafa9-fcd3-418e-b3bd-01510291c65d tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.246328 Dec 15 16:20:57.300808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 22/42] 10.222.0.30 () {58 vars in 1154 bytes} [Wed Dec 15 16:20:57 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:57.323562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3834ba7f-fc81-4d47-9d8c-b8e5138fcebe tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7de99ee0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:57.577315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3834ba7f-fc81-4d47-9d8c-b8e5138fcebe tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.264333 Dec 15 16:20:57.591075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 21/43] 10.222.0.30 () {58 vars in 1187 bytes} [Wed Dec 15 16:20:57 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:20:57.598081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-482ead4e-6666-45bf-89e5-5ac5638bcc64 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] Calling method '.version_select at 0x7f3a7cdeb0d0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:57.832326 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-482ead4e-6666-45bf-89e5-5ac5638bcc64 tempest-VolumesTestJSON-1791024122 tempest-VolumesTestJSON-1791024122-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.238426 Dec 15 16:20:57.845444 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 23/44] 10.222.0.30 () {58 vars in 1154 bytes} [Wed Dec 15 16:20:57 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:58.240674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dae9ace4-4809-42af-80ac-a7734d1bb40a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:58.241725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dae9ace4-4809-42af-80ac-a7734d1bb40a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:58.278858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dae9ace4-4809-42af-80ac-a7734d1bb40a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:58.278858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dae9ace4-4809-42af-80ac-a7734d1bb40a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:58.278858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dae9ace4-4809-42af-80ac-a7734d1bb40a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:58.278858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dae9ace4-4809-42af-80ac-a7734d1bb40a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:58.347733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-16ea9069-ecb5-40f3-bfe7-33652fec0ce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'create', calling method: .version_select at 0x7f3a7de6fc10>, body: {"keypair": {"name": "tempest-keypair-82452724"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:58.514263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dae9ace4-4809-42af-80ac-a7734d1bb40a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:20:58.526503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dae9ace4-4809-42af-80ac-a7734d1bb40a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1273 microversion: 2.1 time: 0.290437 Dec 15 16:20:58.536818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 24/45] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:58 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1273 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:20:58.606718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-16ea9069-ecb5-40f3-bfe7-33652fec0ce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:20:58.635125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-16ea9069-ecb5-40f3-bfe7-33652fec0ce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for user b7f047bf1080497290a18bff8b4e4337 and project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:20:59.589840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-afeddb2d-cad1-4327-9a48-f05ba40c122d tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:20:59.593450 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-afeddb2d-cad1-4327-9a48-f05ba40c122d tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:20:59.614237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afeddb2d-cad1-4327-9a48-f05ba40c122d tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:59.615377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afeddb2d-cad1-4327-9a48-f05ba40c122d tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:59.618555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afeddb2d-cad1-4327-9a48-f05ba40c122d tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:59.620912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afeddb2d-cad1-4327-9a48-f05ba40c122d tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:59.916561 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-16ea9069-ecb5-40f3-bfe7-33652fec0ce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:20:59.946729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-16ea9069-ecb5-40f3-bfe7-33652fec0ce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for user b7f047bf1080497290a18bff8b4e4337 and project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:00.034253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-16ea9069-ecb5-40f3-bfe7-33652fec0ce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.20 time: 2.009007 Dec 15 16:21:00.037826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 22/46] 10.222.0.30 () {62 vars in 1198 bytes} [Wed Dec 15 16:20:58 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 2015 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 15 16:21:00.221901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-afeddb2d-cad1-4327-9a48-f05ba40c122d tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:00.255893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-afeddb2d-cad1-4327-9a48-f05ba40c122d tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1273 microversion: 2.1 time: 0.698599 Dec 15 16:21:00.267687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 25/47] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:20:59 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1273 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:01.306811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d5e24bec-cbe7-49b8-a371-fdfae99b7d26 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:01.311551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d5e24bec-cbe7-49b8-a371-fdfae99b7d26 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:01.417022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5e24bec-cbe7-49b8-a371-fdfae99b7d26 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:01.424603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5e24bec-cbe7-49b8-a371-fdfae99b7d26 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:01.427927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5e24bec-cbe7-49b8-a371-fdfae99b7d26 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:01.439916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5e24bec-cbe7-49b8-a371-fdfae99b7d26 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:02.826818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d5e24bec-cbe7-49b8-a371-fdfae99b7d26 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:02.851790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d5e24bec-cbe7-49b8-a371-fdfae99b7d26 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1273 microversion: 2.1 time: 1.561274 Dec 15 16:21:02.870163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 23/48] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:01 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1273 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:03.887597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e5e1e677-b295-49a1-b9af-ba56794e690a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:03.899962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5e1e677-b295-49a1-b9af-ba56794e690a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:03.927579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e1e677-b295-49a1-b9af-ba56794e690a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:03.928408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e1e677-b295-49a1-b9af-ba56794e690a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:03.929980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e1e677-b295-49a1-b9af-ba56794e690a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:03.930776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e1e677-b295-49a1-b9af-ba56794e690a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:05.882812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5e1e677-b295-49a1-b9af-ba56794e690a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:05.892529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e5e1e677-b295-49a1-b9af-ba56794e690a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 2.012335 Dec 15 16:21:05.906620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 26/49] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:03 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:06.925023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa89d1a4-f42c-44ef-8952-ec91c5071f84 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:06.925741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa89d1a4-f42c-44ef-8952-ec91c5071f84 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:06.943173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa89d1a4-f42c-44ef-8952-ec91c5071f84 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:06.951019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa89d1a4-f42c-44ef-8952-ec91c5071f84 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:06.953472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa89d1a4-f42c-44ef-8952-ec91c5071f84 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:06.954020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa89d1a4-f42c-44ef-8952-ec91c5071f84 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:08.509682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa89d1a4-f42c-44ef-8952-ec91c5071f84 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:08.526144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa89d1a4-f42c-44ef-8952-ec91c5071f84 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 1.600040 Dec 15 16:21:08.540414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 24/50] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:06 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:09.504837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-796755037", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d126a8cf-16e4-4902-b478-769f0a4af951"}]}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:09.545712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5ddd1a66-5779-4249-89dd-6a27d9666db6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:09.548079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5ddd1a66-5779-4249-89dd-6a27d9666db6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:09.565334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ddd1a66-5779-4249-89dd-6a27d9666db6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:09.592147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ddd1a66-5779-4249-89dd-6a27d9666db6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:09.594705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ddd1a66-5779-4249-89dd-6a27d9666db6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:09.598792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ddd1a66-5779-4249-89dd-6a27d9666db6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:09.721500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.network.neutron [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] validate_networks() for [('d126a8cf-16e4-4902-b478-769f0a4af951', None, None, None, None, None)] {{(pid=116021) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:21:11.672365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5ddd1a66-5779-4249-89dd-6a27d9666db6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:11.687008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5ddd1a66-5779-4249-89dd-6a27d9666db6 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 2.144160 Dec 15 16:21:11.704943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 25/51] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:09 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:12.711239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8a878120-ca3d-417f-b7c4-26d10e5c3e72 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:12.712370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8a878120-ca3d-417f-b7c4-26d10e5c3e72 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:12.734973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a878120-ca3d-417f-b7c4-26d10e5c3e72 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:12.736096 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a878120-ca3d-417f-b7c4-26d10e5c3e72 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:12.742910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a878120-ca3d-417f-b7c4-26d10e5c3e72 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:12.747332 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a878120-ca3d-417f-b7c4-26d10e5c3e72 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:13.372974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Flavor limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:21:13.374211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Image limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:21:13.375021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Flavor pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:21:13.375619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Image pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:21:13.377222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:21:13.446043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:13.449414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:13.456492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:13.459394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:13.565000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Getting quotas for project 4fe8b4fae71c484f939fd5379ad2ff16. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:13.576264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Getting quotas for user 17203383b6ed406a959b7a93cf184c4d and project 4fe8b4fae71c484f939fd5379ad2ff16. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:13.595180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Going to run 1 instances... {{(pid=116021) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:21:13.598830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:21:13.691272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-458d4af9-e6fa-4991-81a8-b70b753ee118 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.592310 Dec 15 16:21:13.696647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:21:08 2021] POST /compute/v2.1/servers => generated 383 bytes in 5594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:21:13.698804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1395275577", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29861749-eeff-4f47-ab67-6cbd4ee56a63"}], "security_groups": [{"name": "tempest-securitygroup--1542206977"}], "key_name": "tempest-keypair-82452724", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:14.590923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.network.neutron [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] validate_networks() for [('29861749-eeff-4f47-ab67-6cbd4ee56a63', None, None, None, None, None)] {{(pid=116021) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:21:14.826808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8a878120-ca3d-417f-b7c4-26d10e5c3e72 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:14.848367 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8a878120-ca3d-417f-b7c4-26d10e5c3e72 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 2.137371 Dec 15 16:21:14.850439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 26/53] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:12 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:14.872772 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8a2379bd-0c04-4df6-9043-23bf7de0bdce tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:14.885861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8a2379bd-0c04-4df6-9043-23bf7de0bdce tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:15.231483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8a2379bd-0c04-4df6-9043-23bf7de0bdce tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:15.251230 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8a2379bd-0c04-4df6-9043-23bf7de0bdce tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1221 microversion: 2.1 time: 0.398131 Dec 15 16:21:15.254754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 27/54] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:14 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1221 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:15.883432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-f5544e8a-7123-4e1d-8c28-d0a6ca60984e req-a8ebb8ee-ca5e-4102-aa8d-b4ae1171f67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2898525f-f1df-4a06-b221-a0a13d7b434e", "tag": "fdd6dccd-a268-4005-8f47-c213077b39d8"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:15.886296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:15.886296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:21:15.929308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-f5544e8a-7123-4e1d-8c28-d0a6ca60984e req-a8ebb8ee-ca5e-4102-aa8d-b4ae1171f67c service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:15.930273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-f5544e8a-7123-4e1d-8c28-d0a6ca60984e req-a8ebb8ee-ca5e-4102-aa8d-b4ae1171f67c service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:15.961111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-f5544e8a-7123-4e1d-8c28-d0a6ca60984e req-a8ebb8ee-ca5e-4102-aa8d-b4ae1171f67c service nova] Creating event network-changed:fdd6dccd-a268-4005-8f47-c213077b39d8 for instance 2898525f-f1df-4a06-b221-a0a13d7b434e on hv-cinder-82002 Dec 15 16:21:15.962083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-f5544e8a-7123-4e1d-8c28-d0a6ca60984e req-a8ebb8ee-ca5e-4102-aa8d-b4ae1171f67c service nova] Acquired lock "compute-rpcapi-router" {{(pid=116022) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 16:21:15.963657 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f27e40c-acad-409f-92eb-dc6944bf06b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:15.964752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f27e40c-acad-409f-92eb-dc6944bf06b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:15.966212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f27e40c-acad-409f-92eb-dc6944bf06b3 None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:15.966820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f27e40c-acad-409f-92eb-dc6944bf06b3 None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:15.985984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.compute.rpcapi [None req-1f27e40c-acad-409f-92eb-dc6944bf06b3 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 16:21:15.988682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f27e40c-acad-409f-92eb-dc6944bf06b3 None None] Releasing lock "compute-rpcapi-router" {{(pid=116022) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 16:21:16.033559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1f27e40c-acad-409f-92eb-dc6944bf06b3 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.776714 Dec 15 16:21:16.034290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 28/55] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:16.041193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-715737951", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d126a8cf-16e4-4902-b478-769f0a4af951"}]}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:16.132521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.network.neutron [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] validate_networks() for [('d126a8cf-16e4-4902-b478-769f0a4af951', None, None, None, None, None)] {{(pid=116022) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:21:16.318828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Flavor limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:21:16.319413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Image limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:21:16.319999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Flavor pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:21:16.321603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Image pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:21:16.322278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:21:16.341066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:16.341747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:16.350229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:16.351747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:16.408576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:16.429619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for user b7f047bf1080497290a18bff8b4e4337 and project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:16.458050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Going to run 1 instances... {{(pid=116021) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:21:16.462692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:21:16.578931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bbc9e959-35ac-402c-b6f1-f5eaf61cdbec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.884749 Dec 15 16:21:16.580033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 28/56] 10.222.0.30 () {62 vars in 1187 bytes} [Wed Dec 15 16:21:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 2887 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 16:21:16.591260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d2db917b-abca-4074-b07f-e0cddb2a04bd tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:16.597244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d2db917b-abca-4074-b07f-e0cddb2a04bd tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:16.614847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d2db917b-abca-4074-b07f-e0cddb2a04bd tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:16.615774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d2db917b-abca-4074-b07f-e0cddb2a04bd tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:16.617692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d2db917b-abca-4074-b07f-e0cddb2a04bd tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:16.626242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d2db917b-abca-4074-b07f-e0cddb2a04bd tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:17.381882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d2db917b-abca-4074-b07f-e0cddb2a04bd tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:17.398120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d2db917b-abca-4074-b07f-e0cddb2a04bd tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 0.816368 Dec 15 16:21:17.402434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 29/57] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:16 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:17.408283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-75ff5f56-c136-4f01-883d-d07000199b87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:17.419713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-75ff5f56-c136-4f01-883d-d07000199b87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:17.576363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-75ff5f56-c136-4f01-883d-d07000199b87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:17.607603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-75ff5f56-c136-4f01-883d-d07000199b87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:17.611262 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-75ff5f56-c136-4f01-883d-d07000199b87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:17.623467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-75ff5f56-c136-4f01-883d-d07000199b87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1280 microversion: 2.20 time: 0.219184 Dec 15 16:21:17.649141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 30/58] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:18.422378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4ead03c1-fade-4952-bd28-0098f1e0e6f8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:18.426214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4ead03c1-fade-4952-bd28-0098f1e0e6f8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:18.449268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ead03c1-fade-4952-bd28-0098f1e0e6f8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:18.455240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ead03c1-fade-4952-bd28-0098f1e0e6f8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:18.460669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ead03c1-fade-4952-bd28-0098f1e0e6f8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:18.461912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ead03c1-fade-4952-bd28-0098f1e0e6f8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:18.654016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Flavor limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:21:18.654742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Image limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:21:18.654944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Flavor pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:21:18.655360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Image pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:21:18.655786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:21:18.680749 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:18.681480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:18.682746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:18.683648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:18.777953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Getting quotas for project 4fe8b4fae71c484f939fd5379ad2ff16. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:18.801603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Getting quotas for user 17203383b6ed406a959b7a93cf184c4d and project 4fe8b4fae71c484f939fd5379ad2ff16. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:18.852304 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Going to run 1 instances... {{(pid=116022) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:21:18.869208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:21:18.959437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ead03c1-fade-4952-bd28-0098f1e0e6f8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:18.993647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4ead03c1-fade-4952-bd28-0098f1e0e6f8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 0.576149 Dec 15 16:21:18.996661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 31/59] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:18 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:19.006479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:19.021215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:19.040973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:19.043919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:19.046714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:19.047610 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:19.109989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-455db90b-805e-44a8-a4ea-4188816edca8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.073890 Dec 15 16:21:19.117209 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 29/60] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:21:16 2021] POST /compute/v2.1/servers => generated 383 bytes in 3082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:21:19.123369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-263a8a50-5276-48d5-97c2-8aba5be09bac tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:19.125399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-263a8a50-5276-48d5-97c2-8aba5be09bac tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:19.250181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-263a8a50-5276-48d5-97c2-8aba5be09bac tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:19.266097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-263a8a50-5276-48d5-97c2-8aba5be09bac tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1221 microversion: 2.1 time: 0.146572 Dec 15 16:21:19.268641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 30/61] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:19 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:19.294950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:19.310105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:19.311700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:19.329831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8842e984-ab79-409e-b88d-bc0c1bc99163 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1338 microversion: 2.20 time: 0.330368 Dec 15 16:21:19.332758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1338 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:20.031377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-47f129bd-b468-48e5-9f19-8d3643697c18 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:20.035672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-47f129bd-b468-48e5-9f19-8d3643697c18 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:20.062987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47f129bd-b468-48e5-9f19-8d3643697c18 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:20.065616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47f129bd-b468-48e5-9f19-8d3643697c18 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:20.070919 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47f129bd-b468-48e5-9f19-8d3643697c18 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:20.072714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47f129bd-b468-48e5-9f19-8d3643697c18 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:20.287767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1f9bf9cd-3306-4177-aa47-45e174c42ee7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:20.289422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1f9bf9cd-3306-4177-aa47-45e174c42ee7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:20.302731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f9bf9cd-3306-4177-aa47-45e174c42ee7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:20.307593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f9bf9cd-3306-4177-aa47-45e174c42ee7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:20.309355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f9bf9cd-3306-4177-aa47-45e174c42ee7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:20.312160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f9bf9cd-3306-4177-aa47-45e174c42ee7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:20.834676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1f9bf9cd-3306-4177-aa47-45e174c42ee7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:20.850647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1f9bf9cd-3306-4177-aa47-45e174c42ee7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1225 microversion: 2.1 time: 0.568448 Dec 15 16:21:20.854129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 33/63] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:20 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1225 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:20.861138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:20.870192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:20.879732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:20.880215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:20.890590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:20.895338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:21.194986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:21.214066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:21.239193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:21.241679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2aadbd67-ac26-4bda-98d3-0f8fb3d5603f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1338 microversion: 2.20 time: 0.384117 Dec 15 16:21:21.255107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 34/64] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1338 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:21.255417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-47f129bd-b468-48e5-9f19-8d3643697c18 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:21.276360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-47f129bd-b468-48e5-9f19-8d3643697c18 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 1.251874 Dec 15 16:21:21.280525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 31/65] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:20 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:21.874786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-10f65205-56dd-4e1d-b1ff-f4c3ec61a154 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:21.875419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-10f65205-56dd-4e1d-b1ff-f4c3ec61a154 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:21.890949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10f65205-56dd-4e1d-b1ff-f4c3ec61a154 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:21.891506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10f65205-56dd-4e1d-b1ff-f4c3ec61a154 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:21.893025 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10f65205-56dd-4e1d-b1ff-f4c3ec61a154 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:21.893625 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10f65205-56dd-4e1d-b1ff-f4c3ec61a154 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:22.220151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-10f65205-56dd-4e1d-b1ff-f4c3ec61a154 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:22.229917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-10f65205-56dd-4e1d-b1ff-f4c3ec61a154 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1279 microversion: 2.1 time: 0.358965 Dec 15 16:21:22.239052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 32/66] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:21 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1279 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:22.266765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:22.271758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:22.302232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:22.306518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:22.307866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:22.309055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:22.782432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-35e9449f-6ad0-4f17-b315-8a6607e912cf req-d1f39f91-0380-44c2-b0c2-d4e58bb6ee71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7177930d-42eb-410e-a836-4287e9d78300", "tag": "ae8e0edc-0aca-49bd-a855-113d2a32241a"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:22.795170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:22.795170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:21:22.841761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-35e9449f-6ad0-4f17-b315-8a6607e912cf req-d1f39f91-0380-44c2-b0c2-d4e58bb6ee71 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:22.848331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-35e9449f-6ad0-4f17-b315-8a6607e912cf req-d1f39f91-0380-44c2-b0c2-d4e58bb6ee71 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:22.932263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-35e9449f-6ad0-4f17-b315-8a6607e912cf req-d1f39f91-0380-44c2-b0c2-d4e58bb6ee71 service nova] Creating event network-changed:ae8e0edc-0aca-49bd-a855-113d2a32241a for instance 7177930d-42eb-410e-a836-4287e9d78300 on hv-cinder-82002 Dec 15 16:21:22.933448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-35e9449f-6ad0-4f17-b315-8a6607e912cf req-d1f39f91-0380-44c2-b0c2-d4e58bb6ee71 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116021) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 16:21:22.935276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-388a78a5-f480-477b-8d3d-c53541eaebef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:22.936007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-388a78a5-f480-477b-8d3d-c53541eaebef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:22.937473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-388a78a5-f480-477b-8d3d-c53541eaebef None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:22.938208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-388a78a5-f480-477b-8d3d-c53541eaebef None None] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:22.956734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.compute.rpcapi [None req-388a78a5-f480-477b-8d3d-c53541eaebef None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 16:21:22.958892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-388a78a5-f480-477b-8d3d-c53541eaebef None None] Releasing lock "compute-rpcapi-router" {{(pid=116021) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 16:21:22.961954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:22.975135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:22.984463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:22.987999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1376a4dd-0f09-4b13-9afe-b4f2a4f694c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.726854 Dec 15 16:21:22.990067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:23.012259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-388a78a5-f480-477b-8d3d-c53541eaebef None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.220850 Dec 15 16:21:23.013601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 35/68] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:21:23.015102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4e395d92-b4b5-4b46-a99b-6bd0db081ee8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:23.018102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4e395d92-b4b5-4b46-a99b-6bd0db081ee8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:23.035200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4e395d92-b4b5-4b46-a99b-6bd0db081ee8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:23.037180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4e395d92-b4b5-4b46-a99b-6bd0db081ee8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:23.039831 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4e395d92-b4b5-4b46-a99b-6bd0db081ee8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:23.042024 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4e395d92-b4b5-4b46-a99b-6bd0db081ee8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:23.343117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-b903a199-15b9-410a-9d1e-3dab651b53af req-6edfe8c8-de8f-48bb-ade5-fe8c1481b47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2898525f-f1df-4a06-b221-a0a13d7b434e", "name": "network-vif-plugged", "status": "completed", "tag": "fdd6dccd-a268-4005-8f47-c213077b39d8"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:23.345677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:23.345677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:21:23.358364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-b903a199-15b9-410a-9d1e-3dab651b53af req-6edfe8c8-de8f-48bb-ade5-fe8c1481b47d service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:23.360696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-b903a199-15b9-410a-9d1e-3dab651b53af req-6edfe8c8-de8f-48bb-ade5-fe8c1481b47d service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:23.387776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-b903a199-15b9-410a-9d1e-3dab651b53af req-6edfe8c8-de8f-48bb-ade5-fe8c1481b47d service nova] Creating event network-vif-plugged:fdd6dccd-a268-4005-8f47-c213077b39d8 for instance 2898525f-f1df-4a06-b221-a0a13d7b434e on hv-cinder-82002 Dec 15 16:21:23.394572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-b903a199-15b9-410a-9d1e-3dab651b53af req-6edfe8c8-de8f-48bb-ade5-fe8c1481b47d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176083 Dec 15 16:21:23.395587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 36/69] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:23.404087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-735309a7-317f-45bd-84cc-74ae75cad36e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:23.405075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-735309a7-317f-45bd-84cc-74ae75cad36e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:23.412861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-735309a7-317f-45bd-84cc-74ae75cad36e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:23.413691 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-735309a7-317f-45bd-84cc-74ae75cad36e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:23.415009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-735309a7-317f-45bd-84cc-74ae75cad36e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:23.415471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-735309a7-317f-45bd-84cc-74ae75cad36e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:24.491804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-735309a7-317f-45bd-84cc-74ae75cad36e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:24.513621 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4e395d92-b4b5-4b46-a99b-6bd0db081ee8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:24.538488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-735309a7-317f-45bd-84cc-74ae75cad36e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1279 microversion: 2.1 time: 1.131247 Dec 15 16:21:24.538488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 37/70] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:23 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1279 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:24.544924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4e395d92-b4b5-4b46-a99b-6bd0db081ee8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 1.546295 Dec 15 16:21:24.546305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 34/71] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:22 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:24.567074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:24.568525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:24.589983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:24.597682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:24.599819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:24.619901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:25.206851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:25.232676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:25.236576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:25.253342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-65c0eff4-be46-4452-975f-03c9f41b34ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.710835 Dec 15 16:21:25.257155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 38/72] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:25.317449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-c13aa2dc-266d-4824-9318-d260ed30f391 req-5357bf7d-84fd-45e9-ab73-a6aad1d15df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134cc886-afce-4a89-b875-cdf6768bfd8f", "tag": "9b8f6012-13ef-4292-8d62-47854410ace5"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:25.325130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:25.325130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:21:25.343149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-c13aa2dc-266d-4824-9318-d260ed30f391 req-5357bf7d-84fd-45e9-ab73-a6aad1d15df7 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:25.343997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-c13aa2dc-266d-4824-9318-d260ed30f391 req-5357bf7d-84fd-45e9-ab73-a6aad1d15df7 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:25.371090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-c13aa2dc-266d-4824-9318-d260ed30f391 req-5357bf7d-84fd-45e9-ab73-a6aad1d15df7 service nova] Creating event network-changed:9b8f6012-13ef-4292-8d62-47854410ace5 for instance 134cc886-afce-4a89-b875-cdf6768bfd8f on hv-cinder-82002 Dec 15 16:21:25.390209 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-c13aa2dc-266d-4824-9318-d260ed30f391 req-5357bf7d-84fd-45e9-ab73-a6aad1d15df7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081894 Dec 15 16:21:25.392990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 35/73] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:25.564863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-70ed3d56-3b0b-4949-b34b-6ee0b9d47c18 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:25.566498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-70ed3d56-3b0b-4949-b34b-6ee0b9d47c18 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:25.572216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c83dca13-1d5e-4866-aae7-c4fc17a429f4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:25.574923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c83dca13-1d5e-4866-aae7-c4fc17a429f4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:25.589103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c83dca13-1d5e-4866-aae7-c4fc17a429f4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:25.590020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c83dca13-1d5e-4866-aae7-c4fc17a429f4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:25.591278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c83dca13-1d5e-4866-aae7-c4fc17a429f4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:25.591596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-70ed3d56-3b0b-4949-b34b-6ee0b9d47c18 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:25.592154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-70ed3d56-3b0b-4949-b34b-6ee0b9d47c18 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:25.592522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c83dca13-1d5e-4866-aae7-c4fc17a429f4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:25.593230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-70ed3d56-3b0b-4949-b34b-6ee0b9d47c18 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:25.593677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-70ed3d56-3b0b-4949-b34b-6ee0b9d47c18 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:25.872957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-70ed3d56-3b0b-4949-b34b-6ee0b9d47c18 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:25.899939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-70ed3d56-3b0b-4949-b34b-6ee0b9d47c18 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.343721 Dec 15 16:21:25.917021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 39/74] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:25 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:25.947604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c83dca13-1d5e-4866-aae7-c4fc17a429f4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:25.981430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c83dca13-1d5e-4866-aae7-c4fc17a429f4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 0.418762 Dec 15 16:21:25.992143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 36/75] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:25 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:26.278124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:26.278709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:26.286515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.287423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.288554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.289212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.601033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:26.630076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:26.645404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:26.647870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6553953c-3ff5-4d54-a0ea-bf5811314a77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.373633 Dec 15 16:21:26.657993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 40/76] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:26.932638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f7d302ea-cfd1-4149-9ada-c298bf821bf9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:26.934821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f7d302ea-cfd1-4149-9ada-c298bf821bf9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:26.946672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7d302ea-cfd1-4149-9ada-c298bf821bf9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.947860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7d302ea-cfd1-4149-9ada-c298bf821bf9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.949548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7d302ea-cfd1-4149-9ada-c298bf821bf9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.950598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7d302ea-cfd1-4149-9ada-c298bf821bf9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:27.013306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-002cee4c-ce86-4c81-b0ad-8cac679252c4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:27.014431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-002cee4c-ce86-4c81-b0ad-8cac679252c4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:27.066094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-002cee4c-ce86-4c81-b0ad-8cac679252c4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:27.066898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-002cee4c-ce86-4c81-b0ad-8cac679252c4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:27.068499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-002cee4c-ce86-4c81-b0ad-8cac679252c4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:27.069323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-002cee4c-ce86-4c81-b0ad-8cac679252c4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:28.457695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-002cee4c-ce86-4c81-b0ad-8cac679252c4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:28.473122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-002cee4c-ce86-4c81-b0ad-8cac679252c4 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1315 microversion: 2.1 time: 1.476213 Dec 15 16:21:28.475413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 41/77] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:26 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1315 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:28.489859 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:28.492565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:28.505501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:28.506409 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:28.507640 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:28.511387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:28.585888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f7d302ea-cfd1-4149-9ada-c298bf821bf9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:28.617549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f7d302ea-cfd1-4149-9ada-c298bf821bf9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 1.687296 Dec 15 16:21:28.619174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 37/78] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:26 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:29.407573 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-33873ebc-9548-4f9f-a0eb-ba19686259c3 req-eb69c374-fd78-4832-80c8-ca933a947409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7177930d-42eb-410e-a836-4287e9d78300", "name": "network-vif-plugged", "status": "completed", "tag": "ae8e0edc-0aca-49bd-a855-113d2a32241a"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:29.409852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:29.409852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:21:29.436605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-33873ebc-9548-4f9f-a0eb-ba19686259c3 req-eb69c374-fd78-4832-80c8-ca933a947409 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:29.444101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-33873ebc-9548-4f9f-a0eb-ba19686259c3 req-eb69c374-fd78-4832-80c8-ca933a947409 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:29.500506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-33873ebc-9548-4f9f-a0eb-ba19686259c3 req-eb69c374-fd78-4832-80c8-ca933a947409 service nova] Creating event network-vif-plugged:ae8e0edc-0aca-49bd-a855-113d2a32241a for instance 7177930d-42eb-410e-a836-4287e9d78300 on hv-cinder-82002 Dec 15 16:21:29.526234 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-33873ebc-9548-4f9f-a0eb-ba19686259c3 req-eb69c374-fd78-4832-80c8-ca933a947409 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119361 Dec 15 16:21:29.529734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 38/79] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:21:29.552068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fe784fd7-ad93-4a0d-8d24-29193c05ea54 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:29.553260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fe784fd7-ad93-4a0d-8d24-29193c05ea54 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:29.554606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:29.574430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe784fd7-ad93-4a0d-8d24-29193c05ea54 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:29.579206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe784fd7-ad93-4a0d-8d24-29193c05ea54 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:29.580931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe784fd7-ad93-4a0d-8d24-29193c05ea54 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:29.581394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe784fd7-ad93-4a0d-8d24-29193c05ea54 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:29.581867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:29.586428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:29.587867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6d922e79-9120-40c6-9663-2bb15f8e04de tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 1.110734 Dec 15 16:21:29.596913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 42/80] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:29.640375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-82c3ca56-dd09-44d8-96b1-7906da751ed6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:29.641330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-82c3ca56-dd09-44d8-96b1-7906da751ed6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:29.659102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82c3ca56-dd09-44d8-96b1-7906da751ed6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:29.659858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82c3ca56-dd09-44d8-96b1-7906da751ed6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:29.661113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82c3ca56-dd09-44d8-96b1-7906da751ed6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:29.661731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82c3ca56-dd09-44d8-96b1-7906da751ed6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:30.408403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-82c3ca56-dd09-44d8-96b1-7906da751ed6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:30.422131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-82c3ca56-dd09-44d8-96b1-7906da751ed6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.785398 Dec 15 16:21:30.423379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 43/81] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:29 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:30.429011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fe784fd7-ad93-4a0d-8d24-29193c05ea54 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:30.450484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fe784fd7-ad93-4a0d-8d24-29193c05ea54 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1501 microversion: 2.1 time: 0.919156 Dec 15 16:21:30.451742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 39/82] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:29 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1501 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:30.634877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:30.636364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:30.649331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:30.650116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:30.651235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:30.651892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:31.456338 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-93bf7c59-46e2-46a6-8e69-7599b83a763b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:31.457741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-93bf7c59-46e2-46a6-8e69-7599b83a763b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:31.488386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93bf7c59-46e2-46a6-8e69-7599b83a763b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:31.493734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93bf7c59-46e2-46a6-8e69-7599b83a763b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:31.497597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93bf7c59-46e2-46a6-8e69-7599b83a763b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:31.500281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93bf7c59-46e2-46a6-8e69-7599b83a763b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:31.505904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:31.529958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:31.536309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:31.543023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-40be13c3-3649-402b-806f-60e957a9abb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.910032 Dec 15 16:21:31.546860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 44/83] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:21:31.844226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-070b025a-cae2-41dd-8e6b-bd2a8153d9ba req-725353e9-c7c9-44f1-bb1f-2a9a1d7470e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4f8510-3983-48f4-a221-d78d9c312bc3", "tag": "69e4502f-377a-46f4-96d6-6d687f793676"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:31.858310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:31.858310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:21:31.895920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-070b025a-cae2-41dd-8e6b-bd2a8153d9ba req-725353e9-c7c9-44f1-bb1f-2a9a1d7470e8 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:31.897099 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-070b025a-cae2-41dd-8e6b-bd2a8153d9ba req-725353e9-c7c9-44f1-bb1f-2a9a1d7470e8 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:31.941987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-070b025a-cae2-41dd-8e6b-bd2a8153d9ba req-725353e9-c7c9-44f1-bb1f-2a9a1d7470e8 service nova] Creating event network-changed:69e4502f-377a-46f4-96d6-6d687f793676 for instance 4c4f8510-3983-48f4-a221-d78d9c312bc3 on hv-cinder-82002 Dec 15 16:21:31.971539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-070b025a-cae2-41dd-8e6b-bd2a8153d9ba req-725353e9-c7c9-44f1-bb1f-2a9a1d7470e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137271 Dec 15 16:21:31.973195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 45/84] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:32.265082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-93bf7c59-46e2-46a6-8e69-7599b83a763b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:32.309248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-93bf7c59-46e2-46a6-8e69-7599b83a763b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.854690 Dec 15 16:21:32.310806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 40/85] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:31 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:32.454834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d847be99-5f30-4721-be61-1e2de56d1505 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "124eaca5-626d-4041-b25b-785bc253506f"}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:32.456951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d847be99-5f30-4721-be61-1e2de56d1505 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:32.471999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d847be99-5f30-4721-be61-1e2de56d1505 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.472487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d847be99-5f30-4721-be61-1e2de56d1505 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:32.476853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d847be99-5f30-4721-be61-1e2de56d1505 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.481062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d847be99-5f30-4721-be61-1e2de56d1505 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:32.587139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:32.590135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:32.631754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.633251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:32.639711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.644942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:33.206299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:33.221694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:33.224481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:33.226511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a066136a-25b8-4481-8195-029df7853abf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.650470 Dec 15 16:21:33.227935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 41/86] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:33.247914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d847be99-5f30-4721-be61-1e2de56d1505 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "POST /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799607 Dec 15 16:21:33.252766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 46/87] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Dec 15 16:21:32 2021] POST /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:21:33.335910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4bbbbe50-dfc4-45bc-b071-99a180109fa4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:33.337047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4bbbbe50-dfc4-45bc-b071-99a180109fa4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:33.348866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4bbbbe50-dfc4-45bc-b071-99a180109fa4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:33.350002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4bbbbe50-dfc4-45bc-b071-99a180109fa4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:33.351301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4bbbbe50-dfc4-45bc-b071-99a180109fa4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:33.352093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4bbbbe50-dfc4-45bc-b071-99a180109fa4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:33.572317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4bbbbe50-dfc4-45bc-b071-99a180109fa4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:33.589695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4bbbbe50-dfc4-45bc-b071-99a180109fa4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.263703 Dec 15 16:21:33.590721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 42/88] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:33 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:34.251966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:34.254305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:34.267581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.268997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.270507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.271287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.521730 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:34.536358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:34.539646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:34.541866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0e05d1bd-50b8-4da4-bad2-536997e7e562 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.298328 Dec 15 16:21:34.543446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 47/89] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:34.611314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f00c0427-0063-4bee-9ce3-56af3130fb06 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:34.612662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f00c0427-0063-4bee-9ce3-56af3130fb06 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:34.619756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f00c0427-0063-4bee-9ce3-56af3130fb06 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.620311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f00c0427-0063-4bee-9ce3-56af3130fb06 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.621399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f00c0427-0063-4bee-9ce3-56af3130fb06 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.622042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f00c0427-0063-4bee-9ce3-56af3130fb06 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.882418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f00c0427-0063-4bee-9ce3-56af3130fb06 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:34.893418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f00c0427-0063-4bee-9ce3-56af3130fb06 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.287206 Dec 15 16:21:34.894503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 43/90] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:34 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:35.566091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:35.567178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:35.581740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:35.583776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:35.585775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:35.586722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:35.806459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:35.833735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:35.835934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:35.837295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8a03fa9a-45c9-4a67-83d0-4e919857558f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.279013 Dec 15 16:21:35.838336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 48/91] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:35.920261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-baed3c09-0121-480a-97b8-5bbfa62a5ebf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:35.922906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-baed3c09-0121-480a-97b8-5bbfa62a5ebf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:35.937107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-baed3c09-0121-480a-97b8-5bbfa62a5ebf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:35.938270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-baed3c09-0121-480a-97b8-5bbfa62a5ebf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:35.941032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-baed3c09-0121-480a-97b8-5bbfa62a5ebf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:35.942151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-baed3c09-0121-480a-97b8-5bbfa62a5ebf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:36.326466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-baed3c09-0121-480a-97b8-5bbfa62a5ebf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:36.339418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-baed3c09-0121-480a-97b8-5bbfa62a5ebf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.427949 Dec 15 16:21:36.340454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 44/92] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:35 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:36.855304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:36.856145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:36.869448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:36.871785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:36.872949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:36.873707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.106788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:37.115909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:37.130693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:37.132187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c9579bd2-0363-4380-aa15-7f0501e0b068 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.280939 Dec 15 16:21:37.133059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 49/93] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:37.357765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-65f7cbf1-b3ed-441d-9d43-d0e3483bb210 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:37.358611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-65f7cbf1-b3ed-441d-9d43-d0e3483bb210 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:37.368186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65f7cbf1-b3ed-441d-9d43-d0e3483bb210 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.368997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65f7cbf1-b3ed-441d-9d43-d0e3483bb210 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.370450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65f7cbf1-b3ed-441d-9d43-d0e3483bb210 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.371226 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65f7cbf1-b3ed-441d-9d43-d0e3483bb210 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.595118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-65f7cbf1-b3ed-441d-9d43-d0e3483bb210 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:37.616898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-65f7cbf1-b3ed-441d-9d43-d0e3483bb210 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.263027 Dec 15 16:21:37.619290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 45/94] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:37 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:38.159982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:38.161472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:38.190609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:38.191414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:38.192256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:38.192916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:38.411358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:38.422058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:38.424992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:38.426523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6e3fa8de-26f5-4474-86f9-277f93cf55c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.273288 Dec 15 16:21:38.427104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 50/95] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:38.702395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-37351f8a-1bc4-42f4-9030-798b4ff4665a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:38.703680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-37351f8a-1bc4-42f4-9030-798b4ff4665a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:38.710376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37351f8a-1bc4-42f4-9030-798b4ff4665a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:38.710822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37351f8a-1bc4-42f4-9030-798b4ff4665a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:38.711617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37351f8a-1bc4-42f4-9030-798b4ff4665a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:38.712252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37351f8a-1bc4-42f4-9030-798b4ff4665a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:38.902931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-37351f8a-1bc4-42f4-9030-798b4ff4665a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:38.911512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-37351f8a-1bc4-42f4-9030-798b4ff4665a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.212850 Dec 15 16:21:38.912295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 46/96] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:38 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:39.457554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:39.458663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:39.467766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.468531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.469872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.470609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.636799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:39.646723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:39.648861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:39.650665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4eebc96c-74a0-4c10-baf7-9136a765cde9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.198922 Dec 15 16:21:39.651258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 51/97] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:39.938407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eaa7c9be-f0cf-4135-bc79-b59bb6851a38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:39.939354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eaa7c9be-f0cf-4135-bc79-b59bb6851a38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:39.949039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eaa7c9be-f0cf-4135-bc79-b59bb6851a38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.949916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eaa7c9be-f0cf-4135-bc79-b59bb6851a38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.951492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eaa7c9be-f0cf-4135-bc79-b59bb6851a38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.952239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eaa7c9be-f0cf-4135-bc79-b59bb6851a38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:40.168495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eaa7c9be-f0cf-4135-bc79-b59bb6851a38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:40.176629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eaa7c9be-f0cf-4135-bc79-b59bb6851a38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.242704 Dec 15 16:21:40.177227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 47/98] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:39 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:40.678015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:40.678799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:40.686211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:40.686722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:40.687650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:40.688224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:40.882654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:40.897007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:40.899807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:40.901709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c07c8123-c19e-4f74-98c0-3644a1f0e082 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.227888 Dec 15 16:21:40.902723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 52/99] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:41.198972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7a100986-a1c6-451c-b58d-a386212b3f99 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:41.199827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7a100986-a1c6-451c-b58d-a386212b3f99 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:41.216801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a100986-a1c6-451c-b58d-a386212b3f99 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:41.217348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a100986-a1c6-451c-b58d-a386212b3f99 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:41.219628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a100986-a1c6-451c-b58d-a386212b3f99 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:41.220981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a100986-a1c6-451c-b58d-a386212b3f99 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:41.538454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7a100986-a1c6-451c-b58d-a386212b3f99 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:41.552892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7a100986-a1c6-451c-b58d-a386212b3f99 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.361377 Dec 15 16:21:41.554350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 48/100] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:41 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:41.926425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:41.927373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:41.936323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:41.937429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:41.938315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:41.938849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:42.111771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:42.121504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:42.123230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:42.124487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d24de02d-6be2-430e-8d0c-3c1dc37b2b83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.202752 Dec 15 16:21:42.125847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 53/101] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:42.572368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4a7b0f43-e095-46cd-98ed-ff26d0b8bde8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:42.573941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4a7b0f43-e095-46cd-98ed-ff26d0b8bde8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:42.581092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f43-e095-46cd-98ed-ff26d0b8bde8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:42.581870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f43-e095-46cd-98ed-ff26d0b8bde8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:42.583146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f43-e095-46cd-98ed-ff26d0b8bde8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:42.583763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a7b0f43-e095-46cd-98ed-ff26d0b8bde8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:42.847480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4a7b0f43-e095-46cd-98ed-ff26d0b8bde8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:42.858620 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4a7b0f43-e095-46cd-98ed-ff26d0b8bde8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.290884 Dec 15 16:21:42.869984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 49/102] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:42 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:43.004026 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-3911dda2-a9d1-4a6b-be11-ef62d4b6b4f7 req-0fa35c00-f725-4a57-b69f-2abb5b95f608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134cc886-afce-4a89-b875-cdf6768bfd8f", "name": "network-vif-plugged", "status": "completed", "tag": "9b8f6012-13ef-4292-8d62-47854410ace5"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:43.005810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:43.005810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:21:43.016482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-3911dda2-a9d1-4a6b-be11-ef62d4b6b4f7 req-0fa35c00-f725-4a57-b69f-2abb5b95f608 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:43.017294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-3911dda2-a9d1-4a6b-be11-ef62d4b6b4f7 req-0fa35c00-f725-4a57-b69f-2abb5b95f608 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:43.030782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-3911dda2-a9d1-4a6b-be11-ef62d4b6b4f7 req-0fa35c00-f725-4a57-b69f-2abb5b95f608 service nova] Creating event network-vif-plugged:9b8f6012-13ef-4292-8d62-47854410ace5 for instance 134cc886-afce-4a89-b875-cdf6768bfd8f on hv-cinder-82002 Dec 15 16:21:43.037529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-3911dda2-a9d1-4a6b-be11-ef62d4b6b4f7 req-0fa35c00-f725-4a57-b69f-2abb5b95f608 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037969 Dec 15 16:21:43.038719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 54/103] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:43.144933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:43.145993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:43.154788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:43.155429 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:43.156488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:43.157270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:43.878087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f512f8ee-1f13-445e-bc8c-13c95497a356 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:43.879074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f512f8ee-1f13-445e-bc8c-13c95497a356 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:43.902452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f512f8ee-1f13-445e-bc8c-13c95497a356 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:43.909540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:43.913937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f512f8ee-1f13-445e-bc8c-13c95497a356 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:43.916140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f512f8ee-1f13-445e-bc8c-13c95497a356 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:43.917487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f512f8ee-1f13-445e-bc8c-13c95497a356 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:43.957973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:43.959808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:43.961154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-53ce513a-5f30-4e0f-8a8a-9ce034402eff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.821553 Dec 15 16:21:43.962050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 50/104] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:44.184956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f512f8ee-1f13-445e-bc8c-13c95497a356 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:44.195971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f512f8ee-1f13-445e-bc8c-13c95497a356 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.322654 Dec 15 16:21:44.197070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 55/105] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:43 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:44.992829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:44.993648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:45.001852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.002300 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.003125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.003736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.060012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-eb217d90-7b02-4000-a4ce-fb085048cdf2 req-16acd540-675a-4907-acbc-8c07cace68b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4f8510-3983-48f4-a221-d78d9c312bc3", "name": "network-vif-plugged", "status": "completed", "tag": "69e4502f-377a-46f4-96d6-6d687f793676"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:45.067245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:45.067245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:21:45.085330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-eb217d90-7b02-4000-a4ce-fb085048cdf2 req-16acd540-675a-4907-acbc-8c07cace68b5 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.086062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-eb217d90-7b02-4000-a4ce-fb085048cdf2 req-16acd540-675a-4907-acbc-8c07cace68b5 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.132737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-eb217d90-7b02-4000-a4ce-fb085048cdf2 req-16acd540-675a-4907-acbc-8c07cace68b5 service nova] Creating event network-vif-plugged:69e4502f-377a-46f4-96d6-6d687f793676 for instance 4c4f8510-3983-48f4-a221-d78d9c312bc3 on hv-cinder-82002 Dec 15 16:21:45.162256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-eb217d90-7b02-4000-a4ce-fb085048cdf2 req-16acd540-675a-4907-acbc-8c07cace68b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109121 Dec 15 16:21:45.163678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 56/106] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:45.212502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:45.223667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:45.225929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:45.226937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1a43d222-44d1-41e8-9595-2dca3ae3768e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:45.227847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bfac88e9-ddbf-4c75-94a8-e3d6f0c1f5a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.238713 Dec 15 16:21:45.229135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 51/107] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:45.230704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1a43d222-44d1-41e8-9595-2dca3ae3768e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:45.245183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a43d222-44d1-41e8-9595-2dca3ae3768e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.245667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a43d222-44d1-41e8-9595-2dca3ae3768e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.246488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a43d222-44d1-41e8-9595-2dca3ae3768e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.247189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a43d222-44d1-41e8-9595-2dca3ae3768e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.479132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1a43d222-44d1-41e8-9595-2dca3ae3768e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:45.487874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1a43d222-44d1-41e8-9595-2dca3ae3768e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.269533 Dec 15 16:21:45.488326 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 57/108] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:45 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:46.249930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:46.251744 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:46.261442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:46.262209 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:46.263371 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:46.263970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:46.479288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:46.493220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:46.495414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:46.496837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1f6cbb78-d8e2-46ad-b753-20ad964f5f70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.250748 Dec 15 16:21:46.497700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 52/109] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:21:46.512484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e9a857ba-1ca2-4994-9954-017ecdc47244 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:46.513095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e9a857ba-1ca2-4994-9954-017ecdc47244 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:46.519992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9a857ba-1ca2-4994-9954-017ecdc47244 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:46.520854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9a857ba-1ca2-4994-9954-017ecdc47244 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:46.521268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9a857ba-1ca2-4994-9954-017ecdc47244 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:46.521707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9a857ba-1ca2-4994-9954-017ecdc47244 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:46.682052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e9a857ba-1ca2-4994-9954-017ecdc47244 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:46.691846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e9a857ba-1ca2-4994-9954-017ecdc47244 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.188808 Dec 15 16:21:46.692982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 58/110] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:46 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:47.523531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:47.524265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:47.544797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.544797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:47.544797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.544797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:47.711087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7c80aaee-5cbd-4485-8914-8b1ae0c4a4f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:47.711624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7c80aaee-5cbd-4485-8914-8b1ae0c4a4f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:47.719088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c80aaee-5cbd-4485-8914-8b1ae0c4a4f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.719533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c80aaee-5cbd-4485-8914-8b1ae0c4a4f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:47.720413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c80aaee-5cbd-4485-8914-8b1ae0c4a4f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.721043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c80aaee-5cbd-4485-8914-8b1ae0c4a4f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:48.033332 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:48.043585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7c80aaee-5cbd-4485-8914-8b1ae0c4a4f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:48.056724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:48.057496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7c80aaee-5cbd-4485-8914-8b1ae0c4a4f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.350282 Dec 15 16:21:48.058543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 59/111] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:47 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:48.059460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:48.061964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4ea9578a-08b3-4fe3-b265-b40bbb22b93f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.543540 Dec 15 16:21:48.067493 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 53/112] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:48.230823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a5ae5200-e7a8-4e08-b687-c82cd85ac00f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:48.231662 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a5ae5200-e7a8-4e08-b687-c82cd85ac00f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:48.238476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5ae5200-e7a8-4e08-b687-c82cd85ac00f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:48.239110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5ae5200-e7a8-4e08-b687-c82cd85ac00f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:48.240108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5ae5200-e7a8-4e08-b687-c82cd85ac00f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:48.240354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5ae5200-e7a8-4e08-b687-c82cd85ac00f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:48.271672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a5ae5200-e7a8-4e08-b687-c82cd85ac00f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:21:48.370953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a5ae5200-e7a8-4e08-b687-c82cd85ac00f tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 204 len: 0 microversion: 2.1 time: 0.145342 Dec 15 16:21:48.371556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 60/113] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:21:48 2021] DELETE /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:21:48.384170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-88ed6729-e251-4d0b-9d01-f48fc1d94b09 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:48.385454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-88ed6729-e251-4d0b-9d01-f48fc1d94b09 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:48.396106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-88ed6729-e251-4d0b-9d01-f48fc1d94b09 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:48.397317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-88ed6729-e251-4d0b-9d01-f48fc1d94b09 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:48.398585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-88ed6729-e251-4d0b-9d01-f48fc1d94b09 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:48.399582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-88ed6729-e251-4d0b-9d01-f48fc1d94b09 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:48.584028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-88ed6729-e251-4d0b-9d01-f48fc1d94b09 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:48.592783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-88ed6729-e251-4d0b-9d01-f48fc1d94b09 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.215495 Dec 15 16:21:48.593750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 54/114] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:48 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:49.077426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3c751112-9558-479c-bfef-66f34c0ec325 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:49.078704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3c751112-9558-479c-bfef-66f34c0ec325 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:49.090086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c751112-9558-479c-bfef-66f34c0ec325 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.090836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c751112-9558-479c-bfef-66f34c0ec325 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.092311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c751112-9558-479c-bfef-66f34c0ec325 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.093094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c751112-9558-479c-bfef-66f34c0ec325 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.106574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:49.108227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:49.128568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.129637 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.133544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.135079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.371624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3c751112-9558-479c-bfef-66f34c0ec325 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:49.380264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:49.387060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3c751112-9558-479c-bfef-66f34c0ec325 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.314628 Dec 15 16:21:49.388220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 61/115] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:49 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:49.391104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:49.393035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:49.395522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4ebf917a-30ab-4fc0-8b11-e2767546bbd1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.308539 Dec 15 16:21:49.396135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 55/116] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:49.613638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-65e6bb1e-4f7a-4d79-bec4-755d8a60972e tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:49.614453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-65e6bb1e-4f7a-4d79-bec4-755d8a60972e tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:49.624612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65e6bb1e-4f7a-4d79-bec4-755d8a60972e tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.625381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65e6bb1e-4f7a-4d79-bec4-755d8a60972e tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.627340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65e6bb1e-4f7a-4d79-bec4-755d8a60972e tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.628489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65e6bb1e-4f7a-4d79-bec4-755d8a60972e tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.861451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-65e6bb1e-4f7a-4d79-bec4-755d8a60972e tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:49.873008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-65e6bb1e-4f7a-4d79-bec4-755d8a60972e tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.264437 Dec 15 16:21:49.873647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 62/117] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:49 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:50.406062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7a622001-6dfc-451c-bc12-0d6b2b0ffdb3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:50.406675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7a622001-6dfc-451c-bc12-0d6b2b0ffdb3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:50.413465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a622001-6dfc-451c-bc12-0d6b2b0ffdb3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.413907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a622001-6dfc-451c-bc12-0d6b2b0ffdb3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:50.414705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a622001-6dfc-451c-bc12-0d6b2b0ffdb3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.415132 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a622001-6dfc-451c-bc12-0d6b2b0ffdb3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:50.423837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:50.424879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:50.431666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.432115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:50.432952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.433399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:50.682471 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7a622001-6dfc-451c-bc12-0d6b2b0ffdb3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:50.691639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:50.692952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7a622001-6dfc-451c-bc12-0d6b2b0ffdb3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.290415 Dec 15 16:21:50.693700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 56/118] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:50 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:50.711115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:50.714822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:50.716974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-31d84822-cb76-473a-a95f-5f0e90b5d074 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.296831 Dec 15 16:21:50.717982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 63/119] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:21:50.895323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cd915823-71a2-42b2-869f-6e8bb57e362a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:50.896014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cd915823-71a2-42b2-869f-6e8bb57e362a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:50.905713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd915823-71a2-42b2-869f-6e8bb57e362a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.906738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd915823-71a2-42b2-869f-6e8bb57e362a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:50.909407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd915823-71a2-42b2-869f-6e8bb57e362a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.910883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd915823-71a2-42b2-869f-6e8bb57e362a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:51.104020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cd915823-71a2-42b2-869f-6e8bb57e362a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:51.113161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cd915823-71a2-42b2-869f-6e8bb57e362a tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.223416 Dec 15 16:21:51.114016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 57/120] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:50 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:51.720600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b08a6897-c3e3-42d9-9884-11222a0be6ae tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:51.721455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b08a6897-c3e3-42d9-9884-11222a0be6ae tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:51.727761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b08a6897-c3e3-42d9-9884-11222a0be6ae tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:51.728205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b08a6897-c3e3-42d9-9884-11222a0be6ae tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:51.729364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b08a6897-c3e3-42d9-9884-11222a0be6ae tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:51.729794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b08a6897-c3e3-42d9-9884-11222a0be6ae tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:51.738769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:51.739891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:51.745862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:51.746377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:51.747187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:51.747625 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:51.985432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:51.990877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b08a6897-c3e3-42d9-9884-11222a0be6ae tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:51.996042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:51.997593 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:51.998727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-013a83b7-81f7-46ce-bb9b-bd2f62b96a93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.263808 Dec 15 16:21:51.999306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 58/121] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:52.006987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b08a6897-c3e3-42d9-9884-11222a0be6ae tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.292199 Dec 15 16:21:52.007676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 64/122] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:51 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:52.134358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8a37717a-abfa-4f79-a786-3e2d6c061473 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:52.135161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8a37717a-abfa-4f79-a786-3e2d6c061473 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:52.141587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a37717a-abfa-4f79-a786-3e2d6c061473 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:52.142043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a37717a-abfa-4f79-a786-3e2d6c061473 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:52.143021 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a37717a-abfa-4f79-a786-3e2d6c061473 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:52.143461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a37717a-abfa-4f79-a786-3e2d6c061473 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:52.309438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8a37717a-abfa-4f79-a786-3e2d6c061473 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:52.318737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8a37717a-abfa-4f79-a786-3e2d6c061473 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.188447 Dec 15 16:21:52.319378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 59/123] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:52 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:53.023828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:53.024464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:53.024656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dd1f946a-bed4-41c5-8b4e-9bd832fce3cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:53.025290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dd1f946a-bed4-41c5-8b4e-9bd832fce3cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:53.032424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd1f946a-bed4-41c5-8b4e-9bd832fce3cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.032894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.033121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.033265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd1f946a-bed4-41c5-8b4e-9bd832fce3cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.034399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd1f946a-bed4-41c5-8b4e-9bd832fce3cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.034735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.035027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd1f946a-bed4-41c5-8b4e-9bd832fce3cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.035179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.276257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:53.280602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dd1f946a-bed4-41c5-8b4e-9bd832fce3cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:53.288990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:53.291797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:53.293376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dd1f946a-bed4-41c5-8b4e-9bd832fce3cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.272060 Dec 15 16:21:53.293682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7d4295e5-835e-4391-8717-fb83a5fbf3d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.273719 Dec 15 16:21:53.294321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 60/124] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:53 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:53.294941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 65/125] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:53.336824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-050e4bcf-591c-4a00-a744-ee9d76a4ffc9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:53.337548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-050e4bcf-591c-4a00-a744-ee9d76a4ffc9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:53.344411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-050e4bcf-591c-4a00-a744-ee9d76a4ffc9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.344873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-050e4bcf-591c-4a00-a744-ee9d76a4ffc9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.345848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-050e4bcf-591c-4a00-a744-ee9d76a4ffc9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.346905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-050e4bcf-591c-4a00-a744-ee9d76a4ffc9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.525604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-050e4bcf-591c-4a00-a744-ee9d76a4ffc9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:53.538924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-050e4bcf-591c-4a00-a744-ee9d76a4ffc9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.205420 Dec 15 16:21:53.539964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 61/126] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:53 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:54.318006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:54.319205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:54.323200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-819827d2-be0e-4d69-95ab-7bc71fb1be6b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:54.324287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-819827d2-be0e-4d69-95ab-7bc71fb1be6b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:54.336107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-819827d2-be0e-4d69-95ab-7bc71fb1be6b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.336958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.337182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-819827d2-be0e-4d69-95ab-7bc71fb1be6b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.337615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.338553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-819827d2-be0e-4d69-95ab-7bc71fb1be6b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.338751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.339172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.339358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-819827d2-be0e-4d69-95ab-7bc71fb1be6b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.738597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:54.743526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-819827d2-be0e-4d69-95ab-7bc71fb1be6b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:54.754893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:54.759202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:54.759695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-819827d2-be0e-4d69-95ab-7bc71fb1be6b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1321 microversion: 2.1 time: 0.442885 Dec 15 16:21:54.761312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 62/127] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:54 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:54.763135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f75632ce-81f9-4e63-9574-b9a33e52500b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1406 microversion: 2.20 time: 0.453024 Dec 15 16:21:54.764501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 66/128] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:54.771200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-430f246c-1940-4a88-873c-3e698e5f19be tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:54.772360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-430f246c-1940-4a88-873c-3e698e5f19be tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:54.783942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-430f246c-1940-4a88-873c-3e698e5f19be tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.784652 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-430f246c-1940-4a88-873c-3e698e5f19be tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.786097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-430f246c-1940-4a88-873c-3e698e5f19be tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.786887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-430f246c-1940-4a88-873c-3e698e5f19be tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:55.156745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-430f246c-1940-4a88-873c-3e698e5f19be tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:55.168899 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-430f246c-1940-4a88-873c-3e698e5f19be tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.405613 Dec 15 16:21:55.180102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 63/129] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:54 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:55.782742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:55.783559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:55.785506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bed28a04-9836-46aa-abf9-7ce78f8611a7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:55.786129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bed28a04-9836-46aa-abf9-7ce78f8611a7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:55.792666 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bed28a04-9836-46aa-abf9-7ce78f8611a7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:55.793121 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bed28a04-9836-46aa-abf9-7ce78f8611a7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:55.793616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:55.793914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bed28a04-9836-46aa-abf9-7ce78f8611a7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:55.794358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bed28a04-9836-46aa-abf9-7ce78f8611a7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:55.794478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:55.795200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:55.795634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:55.996551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bed28a04-9836-46aa-abf9-7ce78f8611a7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:55.999862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:56.004105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bed28a04-9836-46aa-abf9-7ce78f8611a7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1516 microversion: 2.1 time: 0.222613 Dec 15 16:21:56.004920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 64/130] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:55 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:56.008546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:56.010035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:56.011205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3365ec1c-c899-4965-90cb-160ba894f46c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1598 microversion: 2.20 time: 0.232496 Dec 15 16:21:56.011769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 67/131] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:21:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1598 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:21:56.021324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2a7bae5a-0776-4f2c-83db-2c412943e7a9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:56.022321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2a7bae5a-0776-4f2c-83db-2c412943e7a9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:56.028552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a7bae5a-0776-4f2c-83db-2c412943e7a9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.028997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a7bae5a-0776-4f2c-83db-2c412943e7a9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.029531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-18674f5a-3758-4a30-b469-7d33562be6cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:56.029771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a7bae5a-0776-4f2c-83db-2c412943e7a9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.030017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-18674f5a-3758-4a30-b469-7d33562be6cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:56.030161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a7bae5a-0776-4f2c-83db-2c412943e7a9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.036760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18674f5a-3758-4a30-b469-7d33562be6cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.037201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18674f5a-3758-4a30-b469-7d33562be6cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.037987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18674f5a-3758-4a30-b469-7d33562be6cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.038411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18674f5a-3758-4a30-b469-7d33562be6cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.093639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-2a7bae5a-0776-4f2c-83db-2c412943e7a9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lazy-loading 'flavor' on Instance uuid 4c4f8510-3983-48f4-a221-d78d9c312bc3 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:21:56.136351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-18674f5a-3758-4a30-b469-7d33562be6cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.110349 Dec 15 16:21:56.136983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 68/132] 10.222.0.30 () {60 vars in 1315 bytes} [Wed Dec 15 16:21:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:21:56.189576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6540688c-4758-4554-8249-7674c1c4f1eb tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:56.190124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6540688c-4758-4554-8249-7674c1c4f1eb tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:56.198916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6540688c-4758-4554-8249-7674c1c4f1eb tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.199796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6540688c-4758-4554-8249-7674c1c4f1eb tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.203785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6540688c-4758-4554-8249-7674c1c4f1eb tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.204365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6540688c-4758-4554-8249-7674c1c4f1eb tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.227202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2a7bae5a-0776-4f2c-83db-2c412943e7a9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "POST /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3/action" status: 200 len: 32 microversion: 2.1 time: 0.209223 Dec 15 16:21:56.227481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 65/133] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:21:56 2021] POST /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:21:56.237525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f85072d3-1710-4499-a126-dccba2673767 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:56.238244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f85072d3-1710-4499-a126-dccba2673767 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:56.245498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f85072d3-1710-4499-a126-dccba2673767 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.245917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f85072d3-1710-4499-a126-dccba2673767 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.246893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f85072d3-1710-4499-a126-dccba2673767 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.247520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f85072d3-1710-4499-a126-dccba2673767 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.700146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6540688c-4758-4554-8249-7674c1c4f1eb tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:56.708968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6540688c-4758-4554-8249-7674c1c4f1eb tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.523755 Dec 15 16:21:56.709608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 69/134] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:56 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:56.710928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f85072d3-1710-4499-a126-dccba2673767 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:56.720064 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f85072d3-1710-4499-a126-dccba2673767 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.486715 Dec 15 16:21:56.721203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 66/135] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:56 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:57.727201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-af27a6ef-b7ee-48c2-b5bd-0cbc88f29899 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:57.727816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-af27a6ef-b7ee-48c2-b5bd-0cbc88f29899 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:57.734982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af27a6ef-b7ee-48c2-b5bd-0cbc88f29899 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:57.735425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af27a6ef-b7ee-48c2-b5bd-0cbc88f29899 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:57.736306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af27a6ef-b7ee-48c2-b5bd-0cbc88f29899 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:57.736755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af27a6ef-b7ee-48c2-b5bd-0cbc88f29899 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:57.739233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-398586f6-c393-4e6b-b970-977a3ce440f3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:57.740501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-398586f6-c393-4e6b-b970-977a3ce440f3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:57.746933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-398586f6-c393-4e6b-b970-977a3ce440f3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:57.747468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-398586f6-c393-4e6b-b970-977a3ce440f3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:57.748375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-398586f6-c393-4e6b-b970-977a3ce440f3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:57.748911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-398586f6-c393-4e6b-b970-977a3ce440f3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.004189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-398586f6-c393-4e6b-b970-977a3ce440f3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:58.005500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-af27a6ef-b7ee-48c2-b5bd-0cbc88f29899 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:58.015347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-af27a6ef-b7ee-48c2-b5bd-0cbc88f29899 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.291747 Dec 15 16:21:58.015944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 70/136] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:57 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:58.018504 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-398586f6-c393-4e6b-b970-977a3ce440f3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.284080 Dec 15 16:21:58.019706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 67/137] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:57 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:58.024604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-47b98229-7c32-4477-a477-9ab94c1c4f29 req-a331ecb4-a091-4187-9211-2beafe421d80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134cc886-afce-4a89-b875-cdf6768bfd8f", "tag": "9b8f6012-13ef-4292-8d62-47854410ace5"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:58.026526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:58.026526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:21:58.032133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-985ebdc7-e129-41ed-8339-561860919792 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:58.034134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-985ebdc7-e129-41ed-8339-561860919792 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:58.040169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-47b98229-7c32-4477-a477-9ab94c1c4f29 req-a331ecb4-a091-4187-9211-2beafe421d80 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:58.040806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-47b98229-7c32-4477-a477-9ab94c1c4f29 req-a331ecb4-a091-4187-9211-2beafe421d80 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.042088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-985ebdc7-e129-41ed-8339-561860919792 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:58.042541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-985ebdc7-e129-41ed-8339-561860919792 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.043351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-985ebdc7-e129-41ed-8339-561860919792 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:58.043783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-985ebdc7-e129-41ed-8339-561860919792 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.054909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-47b98229-7c32-4477-a477-9ab94c1c4f29 req-a331ecb4-a091-4187-9211-2beafe421d80 service nova] Creating event network-changed:9b8f6012-13ef-4292-8d62-47854410ace5 for instance 134cc886-afce-4a89-b875-cdf6768bfd8f on hv-cinder-82002 Dec 15 16:21:58.060873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-47b98229-7c32-4477-a477-9ab94c1c4f29 req-a331ecb4-a091-4187-9211-2beafe421d80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039478 Dec 15 16:21:58.061491 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 68/138] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:58.434023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-985ebdc7-e129-41ed-8339-561860919792 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 14 microversion: 2.20 time: 0.416022 Dec 15 16:21:58.435716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 71/139] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:21:58 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 14 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:59.050107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a481ee0a-21cb-47c7-8852-1f696b83e1ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:59.051365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a481ee0a-21cb-47c7-8852-1f696b83e1ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:59.054887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-986c00ff-7efc-4a7c-93bd-924c3c57b53c tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:59.055874 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-986c00ff-7efc-4a7c-93bd-924c3c57b53c tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:59.072568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-986c00ff-7efc-4a7c-93bd-924c3c57b53c tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.076934 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-986c00ff-7efc-4a7c-93bd-924c3c57b53c tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.078422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a481ee0a-21cb-47c7-8852-1f696b83e1ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.078872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a481ee0a-21cb-47c7-8852-1f696b83e1ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.080890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-986c00ff-7efc-4a7c-93bd-924c3c57b53c tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.082127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a481ee0a-21cb-47c7-8852-1f696b83e1ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.082873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-986c00ff-7efc-4a7c-93bd-924c3c57b53c tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.084399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a481ee0a-21cb-47c7-8852-1f696b83e1ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.474871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-986c00ff-7efc-4a7c-93bd-924c3c57b53c tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:59.480185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a481ee0a-21cb-47c7-8852-1f696b83e1ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:59.486559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-986c00ff-7efc-4a7c-93bd-924c3c57b53c tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.452659 Dec 15 16:21:59.492023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 69/140] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:59 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:59.493239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a481ee0a-21cb-47c7-8852-1f696b83e1ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.453877 Dec 15 16:21:59.494029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 72/141] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:59 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:59.504048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-158aab63-2a99-4000-ada8-61fc38cf7727 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:59.505224 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-158aab63-2a99-4000-ada8-61fc38cf7727 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:59.512937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-158aab63-2a99-4000-ada8-61fc38cf7727 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.513545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-158aab63-2a99-4000-ada8-61fc38cf7727 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.514432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-158aab63-2a99-4000-ada8-61fc38cf7727 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.514967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-158aab63-2a99-4000-ada8-61fc38cf7727 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:00.510407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-040a0a7a-3cb5-4e63-ad1e-d1ab8e5c0e35 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:00.512054 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-040a0a7a-3cb5-4e63-ad1e-d1ab8e5c0e35 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:00.520046 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-040a0a7a-3cb5-4e63-ad1e-d1ab8e5c0e35 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:00.520544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-040a0a7a-3cb5-4e63-ad1e-d1ab8e5c0e35 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:00.521732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-040a0a7a-3cb5-4e63-ad1e-d1ab8e5c0e35 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:00.522171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-040a0a7a-3cb5-4e63-ad1e-d1ab8e5c0e35 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:00.733520 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-040a0a7a-3cb5-4e63-ad1e-d1ab8e5c0e35 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:00.742318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-040a0a7a-3cb5-4e63-ad1e-d1ab8e5c0e35 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.236428 Dec 15 16:22:00.743295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 73/142] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:00 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:00.748036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2ce62572-5f87-4059-bcdf-acb831367c0e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:00.748664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2ce62572-5f87-4059-bcdf-acb831367c0e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:00.755810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ce62572-5f87-4059-bcdf-acb831367c0e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:00.756248 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ce62572-5f87-4059-bcdf-acb831367c0e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:00.757261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ce62572-5f87-4059-bcdf-acb831367c0e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:00.757507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ce62572-5f87-4059-bcdf-acb831367c0e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:00.961628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2ce62572-5f87-4059-bcdf-acb831367c0e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:00.969486 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2ce62572-5f87-4059-bcdf-acb831367c0e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.224986 Dec 15 16:22:00.970083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 74/143] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:00 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:01.761517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0b000936-8454-4b3c-a242-88ef1ca33ada tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:01.762567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0b000936-8454-4b3c-a242-88ef1ca33ada tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:01.769367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0b000936-8454-4b3c-a242-88ef1ca33ada tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.769801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0b000936-8454-4b3c-a242-88ef1ca33ada tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.770596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0b000936-8454-4b3c-a242-88ef1ca33ada tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.771235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0b000936-8454-4b3c-a242-88ef1ca33ada tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.944201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0b000936-8454-4b3c-a242-88ef1ca33ada tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:01.952996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0b000936-8454-4b3c-a242-88ef1ca33ada tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.195244 Dec 15 16:22:01.953686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 75/144] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:01 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:01.987251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b6c2981f-d328-4763-8ad9-fcf34e000f7a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:01.988084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b6c2981f-d328-4763-8ad9-fcf34e000f7a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:01.995222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6c2981f-d328-4763-8ad9-fcf34e000f7a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.995782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6c2981f-d328-4763-8ad9-fcf34e000f7a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.996806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6c2981f-d328-4763-8ad9-fcf34e000f7a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.997816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6c2981f-d328-4763-8ad9-fcf34e000f7a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:02.168903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b6c2981f-d328-4763-8ad9-fcf34e000f7a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:02.177454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b6c2981f-d328-4763-8ad9-fcf34e000f7a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.194654 Dec 15 16:22:02.178062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 76/145] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:01 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:02.263381 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-158aab63-2a99-4000-ada8-61fc38cf7727 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 14 microversion: 2.20 time: 2.769288 Dec 15 16:22:02.264564 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 70/146] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:21:59 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 14 bytes in 2772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:02.970612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fe9779e6-901a-43a0-88e2-677a90a91800 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:02.974745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fe9779e6-901a-43a0-88e2-677a90a91800 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:02.987231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe9779e6-901a-43a0-88e2-677a90a91800 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:02.987565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe9779e6-901a-43a0-88e2-677a90a91800 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:02.988382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe9779e6-901a-43a0-88e2-677a90a91800 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:02.988840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe9779e6-901a-43a0-88e2-677a90a91800 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.204459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8920e619-b6cc-4eda-bca6-9bb1cef85ac6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:03.205128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8920e619-b6cc-4eda-bca6-9bb1cef85ac6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:03.215405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8920e619-b6cc-4eda-bca6-9bb1cef85ac6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.216080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8920e619-b6cc-4eda-bca6-9bb1cef85ac6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.217531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8920e619-b6cc-4eda-bca6-9bb1cef85ac6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.218286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8920e619-b6cc-4eda-bca6-9bb1cef85ac6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.238255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fe9779e6-901a-43a0-88e2-677a90a91800 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:03.249022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fe9779e6-901a-43a0-88e2-677a90a91800 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1553 microversion: 2.1 time: 0.281835 Dec 15 16:22:03.250496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 77/147] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:02 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:03.275753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bc8350f7-ba57-445d-b331-51d8e2f68ccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:03.277573 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bc8350f7-ba57-445d-b331-51d8e2f68ccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:03.286049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc8350f7-ba57-445d-b331-51d8e2f68ccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.286609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc8350f7-ba57-445d-b331-51d8e2f68ccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.287848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc8350f7-ba57-445d-b331-51d8e2f68ccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.288341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc8350f7-ba57-445d-b331-51d8e2f68ccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.353286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bc8350f7-ba57-445d-b331-51d8e2f68ccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 14 microversion: 2.20 time: 0.081377 Dec 15 16:22:03.355067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 78/148] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:03 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:03.459091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8920e619-b6cc-4eda-bca6-9bb1cef85ac6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:03.467609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8920e619-b6cc-4eda-bca6-9bb1cef85ac6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.267718 Dec 15 16:22:03.478007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 71/149] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:03 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:03.807305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-a69f8f17-2291-4989-907f-556ed2df1667 req-c34c7526-9222-4830-8716-06a2e70d81e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2898525f-f1df-4a06-b221-a0a13d7b434e", "name": "network-vif-deleted", "tag": "fdd6dccd-a268-4005-8f47-c213077b39d8"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:03.810904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:03.810904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:22:03.839366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-a69f8f17-2291-4989-907f-556ed2df1667 req-c34c7526-9222-4830-8716-06a2e70d81e3 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.840645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-a69f8f17-2291-4989-907f-556ed2df1667 req-c34c7526-9222-4830-8716-06a2e70d81e3 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.886367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-a69f8f17-2291-4989-907f-556ed2df1667 req-c34c7526-9222-4830-8716-06a2e70d81e3 service nova] Creating event network-vif-deleted:fdd6dccd-a268-4005-8f47-c213077b39d8 for instance 2898525f-f1df-4a06-b221-a0a13d7b434e on hv-cinder-82002 Dec 15 16:22:03.905417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-a69f8f17-2291-4989-907f-556ed2df1667 req-c34c7526-9222-4830-8716-06a2e70d81e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101376 Dec 15 16:22:03.908970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 79/150] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:22:04.270651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-56f232c5-b4f7-4ae8-8127-0f2bee67ed57 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:04.271476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-56f232c5-b4f7-4ae8-8127-0f2bee67ed57 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:04.283162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56f232c5-b4f7-4ae8-8127-0f2bee67ed57 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:04.284321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56f232c5-b4f7-4ae8-8127-0f2bee67ed57 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:04.285341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56f232c5-b4f7-4ae8-8127-0f2bee67ed57 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:04.285964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56f232c5-b4f7-4ae8-8127-0f2bee67ed57 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:04.367410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-56f232c5-b4f7-4ae8-8127-0f2bee67ed57 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:04.369131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b16ba9ee-9bb6-4dd4-a599-e3cdfd41f261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:04.370166 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b16ba9ee-9bb6-4dd4-a599-e3cdfd41f261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:04.377592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16ba9ee-9bb6-4dd4-a599-e3cdfd41f261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:04.378030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16ba9ee-9bb6-4dd4-a599-e3cdfd41f261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:04.379240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16ba9ee-9bb6-4dd4-a599-e3cdfd41f261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:04.379848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16ba9ee-9bb6-4dd4-a599-e3cdfd41f261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:04.380826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-56f232c5-b4f7-4ae8-8127-0f2bee67ed57 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1346 microversion: 2.1 time: 0.114150 Dec 15 16:22:04.381890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 72/151] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:04 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:04.493734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5d1881dc-679f-4fe5-a4b0-3d4809b3ceb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:04.495147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5d1881dc-679f-4fe5-a4b0-3d4809b3ceb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:04.505083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5d1881dc-679f-4fe5-a4b0-3d4809b3ceb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:04.505876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5d1881dc-679f-4fe5-a4b0-3d4809b3ceb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:04.507379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5d1881dc-679f-4fe5-a4b0-3d4809b3ceb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:04.508151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5d1881dc-679f-4fe5-a4b0-3d4809b3ceb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:04.693201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5d1881dc-679f-4fe5-a4b0-3d4809b3ceb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:04.706355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5d1881dc-679f-4fe5-a4b0-3d4809b3ceb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.219980 Dec 15 16:22:04.707384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 73/152] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:04 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:05.404343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2b8b93f3-3521-4dc5-af07-e75e4f4abad8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:05.404985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2b8b93f3-3521-4dc5-af07-e75e4f4abad8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:05.412172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b8b93f3-3521-4dc5-af07-e75e4f4abad8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.412662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b8b93f3-3521-4dc5-af07-e75e4f4abad8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.413497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b8b93f3-3521-4dc5-af07-e75e4f4abad8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.413922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b8b93f3-3521-4dc5-af07-e75e4f4abad8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.485558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2b8b93f3-3521-4dc5-af07-e75e4f4abad8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:05.496964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2b8b93f3-3521-4dc5-af07-e75e4f4abad8 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1346 microversion: 2.1 time: 0.096255 Dec 15 16:22:05.498399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 74/153] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:05 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:05.725420 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a4781a17-78d3-45a8-93fb-389703053320 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:05.726023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a4781a17-78d3-45a8-93fb-389703053320 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:05.732936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4781a17-78d3-45a8-93fb-389703053320 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.733389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4781a17-78d3-45a8-93fb-389703053320 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.734197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4781a17-78d3-45a8-93fb-389703053320 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.734618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4781a17-78d3-45a8-93fb-389703053320 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.916535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a4781a17-78d3-45a8-93fb-389703053320 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:05.925108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a4781a17-78d3-45a8-93fb-389703053320 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.203437 Dec 15 16:22:05.925712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 75/154] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:05 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:06.523441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-867a25df-5806-49c9-99a2-2d48d6ae0ae9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:06.524154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-867a25df-5806-49c9-99a2-2d48d6ae0ae9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:06.530828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-867a25df-5806-49c9-99a2-2d48d6ae0ae9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.531273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-867a25df-5806-49c9-99a2-2d48d6ae0ae9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.532032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-867a25df-5806-49c9-99a2-2d48d6ae0ae9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.532523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-867a25df-5806-49c9-99a2-2d48d6ae0ae9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.593704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-867a25df-5806-49c9-99a2-2d48d6ae0ae9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:06.602283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-867a25df-5806-49c9-99a2-2d48d6ae0ae9 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1346 microversion: 2.1 time: 0.082503 Dec 15 16:22:06.602873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 76/155] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:06 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:06.942714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7cd0439e-8044-4a63-b1d4-0a46a6f6bbc1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:06.943323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7cd0439e-8044-4a63-b1d4-0a46a6f6bbc1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:06.949746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7cd0439e-8044-4a63-b1d4-0a46a6f6bbc1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.950172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7cd0439e-8044-4a63-b1d4-0a46a6f6bbc1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.950966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7cd0439e-8044-4a63-b1d4-0a46a6f6bbc1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.951389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7cd0439e-8044-4a63-b1d4-0a46a6f6bbc1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:07.095917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7cd0439e-8044-4a63-b1d4-0a46a6f6bbc1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:07.103813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7cd0439e-8044-4a63-b1d4-0a46a6f6bbc1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.165028 Dec 15 16:22:07.104804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 77/156] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:06 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:07.221016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b16ba9ee-9bb6-4dd4-a599-e3cdfd41f261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 14 microversion: 2.20 time: 2.856514 Dec 15 16:22:07.221663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 80/157] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:04 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 14 bytes in 2859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:07.620373 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ec20a39a-6662-4140-a036-2f9cabb84dde tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:07.621011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ec20a39a-6662-4140-a036-2f9cabb84dde tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:07.627342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec20a39a-6662-4140-a036-2f9cabb84dde tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:07.627787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec20a39a-6662-4140-a036-2f9cabb84dde tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:07.628615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec20a39a-6662-4140-a036-2f9cabb84dde tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:07.629047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec20a39a-6662-4140-a036-2f9cabb84dde tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:07.687566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ec20a39a-6662-4140-a036-2f9cabb84dde tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7221014c51874578aaaf6f78e5327d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d66ed76bcb74b45acc60dc6a0c965f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:07.696706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ec20a39a-6662-4140-a036-2f9cabb84dde tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 200 len: 1346 microversion: 2.1 time: 0.080242 Dec 15 16:22:07.697414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 78/158] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:07 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 1346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:08.122392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-90bc4694-9c41-4068-a011-1563e714ff7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:08.122961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-90bc4694-9c41-4068-a011-1563e714ff7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:08.130589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90bc4694-9c41-4068-a011-1563e714ff7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.131039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90bc4694-9c41-4068-a011-1563e714ff7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.131930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90bc4694-9c41-4068-a011-1563e714ff7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.132359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90bc4694-9c41-4068-a011-1563e714ff7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.234087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-16dee315-de8b-402b-a5fd-a13d54f508e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:08.235605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-16dee315-de8b-402b-a5fd-a13d54f508e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:08.243322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16dee315-de8b-402b-a5fd-a13d54f508e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.243768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16dee315-de8b-402b-a5fd-a13d54f508e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.244663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16dee315-de8b-402b-a5fd-a13d54f508e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.245093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16dee315-de8b-402b-a5fd-a13d54f508e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.281726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-90bc4694-9c41-4068-a011-1563e714ff7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:08.290302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-90bc4694-9c41-4068-a011-1563e714ff7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.172010 Dec 15 16:22:08.290956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 81/159] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:08 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:08.329991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-16dee315-de8b-402b-a5fd-a13d54f508e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 14 microversion: 2.20 time: 0.100077 Dec 15 16:22:08.330771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 79/160] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:08 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:08.713817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-daf190cd-617d-4623-b4e1-2a22355266f3 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:08.714418 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-daf190cd-617d-4623-b4e1-2a22355266f3 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:08.721783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daf190cd-617d-4623-b4e1-2a22355266f3 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.722250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daf190cd-617d-4623-b4e1-2a22355266f3 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.723076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daf190cd-617d-4623-b4e1-2a22355266f3 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.723510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daf190cd-617d-4623-b4e1-2a22355266f3 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.742087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-daf190cd-617d-4623-b4e1-2a22355266f3 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] HTTP exception thrown: Instance 2898525f-f1df-4a06-b221-a0a13d7b434e could not be found. Dec 15 16:22:08.742947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-daf190cd-617d-4623-b4e1-2a22355266f3 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Returning 404 to user: Instance 2898525f-f1df-4a06-b221-a0a13d7b434e could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:08.744047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-daf190cd-617d-4623-b4e1-2a22355266f3 tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 404 len: 111 microversion: 2.1 time: 0.033887 Dec 15 16:22:08.744900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 82/161] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:08 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:08.852970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-04dbeea3-7b7b-4ed9-b426-4249a53c21ab tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:08.854058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-04dbeea3-7b7b-4ed9-b426-4249a53c21ab tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:08.861826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04dbeea3-7b7b-4ed9-b426-4249a53c21ab tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.862683 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04dbeea3-7b7b-4ed9-b426-4249a53c21ab tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.863593 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04dbeea3-7b7b-4ed9-b426-4249a53c21ab tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.864116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04dbeea3-7b7b-4ed9-b426-4249a53c21ab tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.880909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-04dbeea3-7b7b-4ed9-b426-4249a53c21ab tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] HTTP exception thrown: Instance 2898525f-f1df-4a06-b221-a0a13d7b434e could not be found. Dec 15 16:22:08.882308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-04dbeea3-7b7b-4ed9-b426-4249a53c21ab tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Returning 404 to user: Instance 2898525f-f1df-4a06-b221-a0a13d7b434e could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:08.891076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-04dbeea3-7b7b-4ed9-b426-4249a53c21ab tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042063 Dec 15 16:22:08.891802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 80/162] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:22:08 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:09.309512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f55917cb-4f8e-4efd-9e9a-5cb160f90760 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:09.310113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f55917cb-4f8e-4efd-9e9a-5cb160f90760 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:09.320679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f55917cb-4f8e-4efd-9e9a-5cb160f90760 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.321159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f55917cb-4f8e-4efd-9e9a-5cb160f90760 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.322230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f55917cb-4f8e-4efd-9e9a-5cb160f90760 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.322868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f55917cb-4f8e-4efd-9e9a-5cb160f90760 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.343196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c1e709b6-a384-47fa-b184-3dedb494af5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:09.345380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c1e709b6-a384-47fa-b184-3dedb494af5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:09.357714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1e709b6-a384-47fa-b184-3dedb494af5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.358366 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1e709b6-a384-47fa-b184-3dedb494af5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.359551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1e709b6-a384-47fa-b184-3dedb494af5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.360157 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1e709b6-a384-47fa-b184-3dedb494af5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.450466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c1e709b6-a384-47fa-b184-3dedb494af5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 1462 microversion: 2.20 time: 0.112718 Dec 15 16:22:09.453877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 81/163] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:09 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 1462 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:22:09.481169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f55917cb-4f8e-4efd-9e9a-5cb160f90760 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:09.489766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f55917cb-4f8e-4efd-9e9a-5cb160f90760 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.183994 Dec 15 16:22:09.490388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 83/164] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:09 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:10.204423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-21d7a797-e815-41b7-807a-bb4dd996e53b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:10.206290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-21d7a797-e815-41b7-807a-bb4dd996e53b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:10.218270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21d7a797-e815-41b7-807a-bb4dd996e53b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.219090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21d7a797-e815-41b7-807a-bb4dd996e53b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.220302 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21d7a797-e815-41b7-807a-bb4dd996e53b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.221700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21d7a797-e815-41b7-807a-bb4dd996e53b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.239995 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-21d7a797-e815-41b7-807a-bb4dd996e53b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] HTTP exception thrown: Instance 2898525f-f1df-4a06-b221-a0a13d7b434e could not be found. Dec 15 16:22:10.240794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-21d7a797-e815-41b7-807a-bb4dd996e53b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Returning 404 to user: Instance 2898525f-f1df-4a06-b221-a0a13d7b434e could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:10.241755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-21d7a797-e815-41b7-807a-bb4dd996e53b tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 404 len: 111 microversion: 2.1 time: 0.045525 Dec 15 16:22:10.245853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 82/165] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:22:10 2021] DELETE /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:10.250632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-111a2fc8-d2ce-4394-b8b7-47d8a3e97eea tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:10.251332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-111a2fc8-d2ce-4394-b8b7-47d8a3e97eea tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] [instance: 2898525f-f1df-4a06-b221-a0a13d7b434e] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:10.265254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-111a2fc8-d2ce-4394-b8b7-47d8a3e97eea tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.266625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-111a2fc8-d2ce-4394-b8b7-47d8a3e97eea tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.268570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-111a2fc8-d2ce-4394-b8b7-47d8a3e97eea tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.269605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-111a2fc8-d2ce-4394-b8b7-47d8a3e97eea tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.298286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-111a2fc8-d2ce-4394-b8b7-47d8a3e97eea tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] HTTP exception thrown: Instance 2898525f-f1df-4a06-b221-a0a13d7b434e could not be found. Dec 15 16:22:10.299788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-111a2fc8-d2ce-4394-b8b7-47d8a3e97eea tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] Returning 404 to user: Instance 2898525f-f1df-4a06-b221-a0a13d7b434e could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:10.301650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-111a2fc8-d2ce-4394-b8b7-47d8a3e97eea tempest-DeleteServersTestJSON-140437171 tempest-DeleteServersTestJSON-140437171-project] 10.222.0.30 "GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e" status: 404 len: 111 microversion: 2.1 time: 0.054562 Dec 15 16:22:10.303128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 84/166] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:10 2021] GET /compute/v2.1/servers/2898525f-f1df-4a06-b221-a0a13d7b434e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:22:10.464202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-756efcff-9e4d-4274-89f7-a4f6338ae4e1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:10.465303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-756efcff-9e4d-4274-89f7-a4f6338ae4e1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:10.494251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-756efcff-9e4d-4274-89f7-a4f6338ae4e1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.495159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-756efcff-9e4d-4274-89f7-a4f6338ae4e1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.496463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-756efcff-9e4d-4274-89f7-a4f6338ae4e1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.497069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-756efcff-9e4d-4274-89f7-a4f6338ae4e1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.507720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2f279b97-99d6-49dd-a2fe-b3b093553895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:10.509056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2f279b97-99d6-49dd-a2fe-b3b093553895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:10.517893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f279b97-99d6-49dd-a2fe-b3b093553895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.518671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f279b97-99d6-49dd-a2fe-b3b093553895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.519560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f279b97-99d6-49dd-a2fe-b3b093553895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.520012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f279b97-99d6-49dd-a2fe-b3b093553895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.638521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-756efcff-9e4d-4274-89f7-a4f6338ae4e1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 8749 microversion: 2.20 time: 0.177166 Dec 15 16:22:10.638521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 83/167] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:10 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 8749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:22:10.766058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2f279b97-99d6-49dd-a2fe-b3b093553895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:10.787856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2f279b97-99d6-49dd-a2fe-b3b093553895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.284418 Dec 15 16:22:10.789821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 85/168] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:10 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:11.651191 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a36e06c7-be08-40e1-8d0e-f5e7024b090a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:11.652475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a36e06c7-be08-40e1-8d0e-f5e7024b090a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:11.665229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a36e06c7-be08-40e1-8d0e-f5e7024b090a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.666964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a36e06c7-be08-40e1-8d0e-f5e7024b090a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.669626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a36e06c7-be08-40e1-8d0e-f5e7024b090a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.673528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a36e06c7-be08-40e1-8d0e-f5e7024b090a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.787562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a36e06c7-be08-40e1-8d0e-f5e7024b090a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 15025 microversion: 2.20 time: 0.141046 Dec 15 16:22:11.796979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 84/169] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:11 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 15025 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:11.814611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eb7cd281-7fbb-459c-987f-090a79887b1d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:11.816831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eb7cd281-7fbb-459c-987f-090a79887b1d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:11.829675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb7cd281-7fbb-459c-987f-090a79887b1d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.832920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb7cd281-7fbb-459c-987f-090a79887b1d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.834653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb7cd281-7fbb-459c-987f-090a79887b1d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.836392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb7cd281-7fbb-459c-987f-090a79887b1d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:12.105264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eb7cd281-7fbb-459c-987f-090a79887b1d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:12.113632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eb7cd281-7fbb-459c-987f-090a79887b1d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.303035 Dec 15 16:22:12.114407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 86/170] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:11 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:12.809279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bd63c95a-6861-4bd6-9f5f-cc38803b6ad0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:12.812867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bd63c95a-6861-4bd6-9f5f-cc38803b6ad0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:12.826563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd63c95a-6861-4bd6-9f5f-cc38803b6ad0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:12.827872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd63c95a-6861-4bd6-9f5f-cc38803b6ad0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:12.830102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd63c95a-6861-4bd6-9f5f-cc38803b6ad0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:12.831153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd63c95a-6861-4bd6-9f5f-cc38803b6ad0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.132256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-66605ae2-8a75-423f-8f94-78e6fd394052 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:13.133498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-66605ae2-8a75-423f-8f94-78e6fd394052 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:13.140244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66605ae2-8a75-423f-8f94-78e6fd394052 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.140720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66605ae2-8a75-423f-8f94-78e6fd394052 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.141508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66605ae2-8a75-423f-8f94-78e6fd394052 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.141931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66605ae2-8a75-423f-8f94-78e6fd394052 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.362492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-66605ae2-8a75-423f-8f94-78e6fd394052 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:13.383001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-66605ae2-8a75-423f-8f94-78e6fd394052 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.254535 Dec 15 16:22:13.384070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 87/171] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:13 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:14.404958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c7f6b7e2-5ed5-4b74-ba72-a629d019dc49 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:14.406944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c7f6b7e2-5ed5-4b74-ba72-a629d019dc49 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:14.416638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7f6b7e2-5ed5-4b74-ba72-a629d019dc49 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.418031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7f6b7e2-5ed5-4b74-ba72-a629d019dc49 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.419235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7f6b7e2-5ed5-4b74-ba72-a629d019dc49 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.419842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7f6b7e2-5ed5-4b74-ba72-a629d019dc49 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.691354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c7f6b7e2-5ed5-4b74-ba72-a629d019dc49 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:14.706553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c7f6b7e2-5ed5-4b74-ba72-a629d019dc49 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.307382 Dec 15 16:22:14.707652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 88/172] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:14 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:15.098476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bd63c95a-6861-4bd6-9f5f-cc38803b6ad0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 19894 microversion: 2.20 time: 2.297894 Dec 15 16:22:15.099232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 85/173] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:12 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 19894 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:15.723598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-91f1b7ee-c291-443f-914d-6f913b4bab88 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:15.724959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-91f1b7ee-c291-443f-914d-6f913b4bab88 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:15.734655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91f1b7ee-c291-443f-914d-6f913b4bab88 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.737270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91f1b7ee-c291-443f-914d-6f913b4bab88 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.738400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91f1b7ee-c291-443f-914d-6f913b4bab88 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.739817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91f1b7ee-c291-443f-914d-6f913b4bab88 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.981900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-91f1b7ee-c291-443f-914d-6f913b4bab88 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:16.003864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-91f1b7ee-c291-443f-914d-6f913b4bab88 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.284381 Dec 15 16:22:16.010637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 89/174] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:15 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:16.120015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b56269f2-a579-4aae-84cb-3a74d3b86736 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:16.122125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b56269f2-a579-4aae-84cb-3a74d3b86736 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:16.140670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b56269f2-a579-4aae-84cb-3a74d3b86736 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.144070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b56269f2-a579-4aae-84cb-3a74d3b86736 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.155911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b56269f2-a579-4aae-84cb-3a74d3b86736 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.156585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b56269f2-a579-4aae-84cb-3a74d3b86736 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.390772 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b56269f2-a579-4aae-84cb-3a74d3b86736 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 22127 microversion: 2.20 time: 0.278186 Dec 15 16:22:16.393210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 86/175] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:16 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 22127 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:17.025979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-245c863d-8b07-4e3d-8c4e-0168aade1fa5 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:17.027321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-245c863d-8b07-4e3d-8c4e-0168aade1fa5 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:17.041733 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-245c863d-8b07-4e3d-8c4e-0168aade1fa5 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.044029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-245c863d-8b07-4e3d-8c4e-0168aade1fa5 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.049625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-245c863d-8b07-4e3d-8c4e-0168aade1fa5 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.050662 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-245c863d-8b07-4e3d-8c4e-0168aade1fa5 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.406397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-862394a8-d720-4298-b8e4-50a11e8584c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:17.407424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-862394a8-d720-4298-b8e4-50a11e8584c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:17.432777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-862394a8-d720-4298-b8e4-50a11e8584c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.433227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-862394a8-d720-4298-b8e4-50a11e8584c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.441277 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-862394a8-d720-4298-b8e4-50a11e8584c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.441789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-862394a8-d720-4298-b8e4-50a11e8584c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.475808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-245c863d-8b07-4e3d-8c4e-0168aade1fa5 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:17.489112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-245c863d-8b07-4e3d-8c4e-0168aade1fa5 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.466789 Dec 15 16:22:17.518053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 90/176] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:17 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:17.630931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-862394a8-d720-4298-b8e4-50a11e8584c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 23241 microversion: 2.20 time: 0.228543 Dec 15 16:22:17.634106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 87/177] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:17 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 23241 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:22:18.512757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1c2a7d1d-0a53-49ee-8d86-831cd5480ddb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:18.514087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1c2a7d1d-0a53-49ee-8d86-831cd5480ddb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:18.533863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c2a7d1d-0a53-49ee-8d86-831cd5480ddb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.534348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c2a7d1d-0a53-49ee-8d86-831cd5480ddb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.544321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c2a7d1d-0a53-49ee-8d86-831cd5480ddb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.549032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c2a7d1d-0a53-49ee-8d86-831cd5480ddb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.653052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8f2e7c5a-9454-42d6-8de3-d0c03d6cf6f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:18.655156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8f2e7c5a-9454-42d6-8de3-d0c03d6cf6f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:18.677744 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f2e7c5a-9454-42d6-8de3-d0c03d6cf6f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.678496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f2e7c5a-9454-42d6-8de3-d0c03d6cf6f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.682603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f2e7c5a-9454-42d6-8de3-d0c03d6cf6f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.683830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f2e7c5a-9454-42d6-8de3-d0c03d6cf6f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.797596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8f2e7c5a-9454-42d6-8de3-d0c03d6cf6f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 23977 microversion: 2.20 time: 0.153427 Dec 15 16:22:18.801154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 88/178] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:18 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 23977 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:19.069615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1c2a7d1d-0a53-49ee-8d86-831cd5480ddb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:19.077538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1c2a7d1d-0a53-49ee-8d86-831cd5480ddb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.569278 Dec 15 16:22:19.078130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 91/179] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:18 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:19.817566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-21c213fe-de85-47fc-b49b-9dc5f33e6e52 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:19.819422 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-21c213fe-de85-47fc-b49b-9dc5f33e6e52 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:19.829298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21c213fe-de85-47fc-b49b-9dc5f33e6e52 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:19.830154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21c213fe-de85-47fc-b49b-9dc5f33e6e52 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:19.834225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21c213fe-de85-47fc-b49b-9dc5f33e6e52 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:19.848454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21c213fe-de85-47fc-b49b-9dc5f33e6e52 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.095507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b9a44cf8-1b7e-4270-be13-c3a04bc96e02 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:20.098229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b9a44cf8-1b7e-4270-be13-c3a04bc96e02 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:20.109042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9a44cf8-1b7e-4270-be13-c3a04bc96e02 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.109736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9a44cf8-1b7e-4270-be13-c3a04bc96e02 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.111034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9a44cf8-1b7e-4270-be13-c3a04bc96e02 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.112232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9a44cf8-1b7e-4270-be13-c3a04bc96e02 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.613797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b9a44cf8-1b7e-4270-be13-c3a04bc96e02 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:20.623273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b9a44cf8-1b7e-4270-be13-c3a04bc96e02 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.532587 Dec 15 16:22:20.629258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 92/180] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:20 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:21.649461 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d0ae8a0b-965d-4592-8208-0ad7cdf66f54 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:21.650412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d0ae8a0b-965d-4592-8208-0ad7cdf66f54 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:21.674644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d0ae8a0b-965d-4592-8208-0ad7cdf66f54 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.675195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d0ae8a0b-965d-4592-8208-0ad7cdf66f54 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.676219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d0ae8a0b-965d-4592-8208-0ad7cdf66f54 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.676886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d0ae8a0b-965d-4592-8208-0ad7cdf66f54 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:22.239609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d0ae8a0b-965d-4592-8208-0ad7cdf66f54 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:22.248154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d0ae8a0b-965d-4592-8208-0ad7cdf66f54 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.603130 Dec 15 16:22:22.249368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 93/181] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:21 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:22.467596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-21c213fe-de85-47fc-b49b-9dc5f33e6e52 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 27508 microversion: 2.20 time: 2.654805 Dec 15 16:22:22.471339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 89/182] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:19 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 27508 bytes in 2660 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:22.808559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-07bd90d2-f277-41d5-9287-2165c970c22a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'create', calling method: .version_select at 0x7f3a7cc1c820>, body: {"keypair": {"name": "tempest-keypair-1359795542"}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:22.849308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-07bd90d2-f277-41d5-9287-2165c970c22a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for project 9264b7d2b1b4444f848035561e48c126. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:22:22.866524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-07bd90d2-f277-41d5-9287-2165c970c22a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for user 5686da93293e439eaf999b67fc154b14 and project 9264b7d2b1b4444f848035561e48c126. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:22:23.145596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-07bd90d2-f277-41d5-9287-2165c970c22a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for project 9264b7d2b1b4444f848035561e48c126. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:22:23.154762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-07bd90d2-f277-41d5-9287-2165c970c22a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for user 5686da93293e439eaf999b67fc154b14 and project 9264b7d2b1b4444f848035561e48c126. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:22:23.174971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-07bd90d2-f277-41d5-9287-2165c970c22a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.763215 Dec 15 16:22:23.175934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 94/183] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Dec 15 16:22:22 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:23.280391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-de792592-2763-41d7-a2b3-7a07febd23f6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:23.282467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-de792592-2763-41d7-a2b3-7a07febd23f6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:23.303576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de792592-2763-41d7-a2b3-7a07febd23f6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.304837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de792592-2763-41d7-a2b3-7a07febd23f6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.306933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de792592-2763-41d7-a2b3-7a07febd23f6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.307946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de792592-2763-41d7-a2b3-7a07febd23f6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.490442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-69726575-63b2-4ddd-985d-a698ad73422e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:23.492060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-69726575-63b2-4ddd-985d-a698ad73422e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:23.533601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69726575-63b2-4ddd-985d-a698ad73422e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.533992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69726575-63b2-4ddd-985d-a698ad73422e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.541827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69726575-63b2-4ddd-985d-a698ad73422e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.543546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69726575-63b2-4ddd-985d-a698ad73422e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.741358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-69726575-63b2-4ddd-985d-a698ad73422e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 27788 microversion: 2.20 time: 0.258097 Dec 15 16:22:23.743467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 95/184] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:23 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 27788 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:23.932693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-de792592-2763-41d7-a2b3-7a07febd23f6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:23.944549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-de792592-2763-41d7-a2b3-7a07febd23f6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.671278 Dec 15 16:22:23.949915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 90/185] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:23 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:24.757241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3c2862dd-563a-463a-966c-3f9b518ed737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:24.759477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3c2862dd-563a-463a-966c-3f9b518ed737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:24.771252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c2862dd-563a-463a-966c-3f9b518ed737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.773194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c2862dd-563a-463a-966c-3f9b518ed737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.777752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c2862dd-563a-463a-966c-3f9b518ed737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.780219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c2862dd-563a-463a-966c-3f9b518ed737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.978322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-05eda80f-762e-421c-96e9-16e172662b21 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:24.980352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-05eda80f-762e-421c-96e9-16e172662b21 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:24.998482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05eda80f-762e-421c-96e9-16e172662b21 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.999394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05eda80f-762e-421c-96e9-16e172662b21 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:25.001349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05eda80f-762e-421c-96e9-16e172662b21 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:25.002202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05eda80f-762e-421c-96e9-16e172662b21 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:25.222188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-05eda80f-762e-421c-96e9-16e172662b21 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:25.232907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-05eda80f-762e-421c-96e9-16e172662b21 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.260080 Dec 15 16:22:25.234312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 91/186] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:24 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:26.251440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-314ee63d-21bb-4325-93cf-48b190be42b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:26.255657 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-314ee63d-21bb-4325-93cf-48b190be42b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:26.270124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-314ee63d-21bb-4325-93cf-48b190be42b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:26.271466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-314ee63d-21bb-4325-93cf-48b190be42b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:26.272423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-314ee63d-21bb-4325-93cf-48b190be42b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:26.273170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-314ee63d-21bb-4325-93cf-48b190be42b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:26.659033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-314ee63d-21bb-4325-93cf-48b190be42b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:26.673569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-314ee63d-21bb-4325-93cf-48b190be42b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.425042 Dec 15 16:22:26.688636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 92/187] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:26 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:26.694771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1443401854", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76827dcc-7b99-494c-b3aa-89beb62d532b"}], "security_groups": [{"name": "tempest-securitygroup--1999482898"}], "key_name": "tempest-keypair-1359795542", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:26.947163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.network.neutron [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] validate_networks() for [('76827dcc-7b99-494c-b3aa-89beb62d532b', None, None, None, None, None)] {{(pid=116022) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:22:27.875095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3c2862dd-563a-463a-966c-3f9b518ed737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 27934 microversion: 2.20 time: 3.122845 Dec 15 16:22:27.876741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 96/188] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:24 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 27934 bytes in 3126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:27.908448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f9a0c122-955f-4d96-8832-4a7d26374121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:27.911032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f9a0c122-955f-4d96-8832-4a7d26374121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:27.928232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9a0c122-955f-4d96-8832-4a7d26374121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:27.935359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9a0c122-955f-4d96-8832-4a7d26374121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:27.937425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9a0c122-955f-4d96-8832-4a7d26374121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:27.938446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9a0c122-955f-4d96-8832-4a7d26374121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:27.939039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Flavor limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:22:27.940234 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Image limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:22:27.942175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Flavor pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:22:27.943393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Image pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:22:27.943833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:22:27.980832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:27.982312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:27.984277 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:27.985832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:28.036989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for project 9264b7d2b1b4444f848035561e48c126. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:22:28.045763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for user 5686da93293e439eaf999b67fc154b14 and project 9264b7d2b1b4444f848035561e48c126. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:22:28.064650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Going to run 1 instances... {{(pid=116022) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:22:28.067901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:22:28.209544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f9a0c122-955f-4d96-8832-4a7d26374121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:28.221163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-067d593c-a472-4621-9404-9d52fdc55a03 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.510199 Dec 15 16:22:28.222227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 93/189] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:22:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:22:28.225546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f9a0c122-955f-4d96-8832-4a7d26374121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.344752 Dec 15 16:22:28.226673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 97/190] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:27 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:28.240888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-af7b4509-8ada-4a78-b8b3-5e3a1ec749b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:28.242178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-af7b4509-8ada-4a78-b8b3-5e3a1ec749b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:28.322430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-af7b4509-8ada-4a78-b8b3-5e3a1ec749b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:28.334212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-af7b4509-8ada-4a78-b8b3-5e3a1ec749b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1238 microversion: 2.1 time: 0.100770 Dec 15 16:22:28.335243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 94/191] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:28.890842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-90279fb2-f86e-48af-9ec5-f834c0603aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:28.892912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-90279fb2-f86e-48af-9ec5-f834c0603aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:28.913828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90279fb2-f86e-48af-9ec5-f834c0603aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:28.920565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90279fb2-f86e-48af-9ec5-f834c0603aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:28.920565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90279fb2-f86e-48af-9ec5-f834c0603aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:28.920565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90279fb2-f86e-48af-9ec5-f834c0603aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.254768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a950b5c7-a4df-4b55-a4f3-b5a0b44a425d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:29.256125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a950b5c7-a4df-4b55-a4f3-b5a0b44a425d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:29.268451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a950b5c7-a4df-4b55-a4f3-b5a0b44a425d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.269749 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a950b5c7-a4df-4b55-a4f3-b5a0b44a425d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.273227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a950b5c7-a4df-4b55-a4f3-b5a0b44a425d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.274641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a950b5c7-a4df-4b55-a4f3-b5a0b44a425d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.536727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a950b5c7-a4df-4b55-a4f3-b5a0b44a425d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:29.571538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a950b5c7-a4df-4b55-a4f3-b5a0b44a425d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.316939 Dec 15 16:22:29.576545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 95/192] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:29 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:29.596121 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9dd9344e-c8b2-41b3-b314-700804ea3e2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:29.597305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9dd9344e-c8b2-41b3-b314-700804ea3e2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:29.613425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9dd9344e-c8b2-41b3-b314-700804ea3e2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.613904 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9dd9344e-c8b2-41b3-b314-700804ea3e2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.615522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9dd9344e-c8b2-41b3-b314-700804ea3e2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.616009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9dd9344e-c8b2-41b3-b314-700804ea3e2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.701863 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9dd9344e-c8b2-41b3-b314-700804ea3e2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:29.717876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9dd9344e-c8b2-41b3-b314-700804ea3e2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1242 microversion: 2.1 time: 0.139182 Dec 15 16:22:29.719519 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 96/193] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:30.590698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6636be2a-2c2c-4759-86b4-edca640cf61d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:30.591724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6636be2a-2c2c-4759-86b4-edca640cf61d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:30.598703 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6636be2a-2c2c-4759-86b4-edca640cf61d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.599240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6636be2a-2c2c-4759-86b4-edca640cf61d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.600314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6636be2a-2c2c-4759-86b4-edca640cf61d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.600851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6636be2a-2c2c-4759-86b4-edca640cf61d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.781795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6636be2a-2c2c-4759-86b4-edca640cf61d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:30.790090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6636be2a-2c2c-4759-86b4-edca640cf61d tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.203760 Dec 15 16:22:30.790693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 97/194] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:30 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:30.804744 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-49773de0-ff19-4291-8704-1bad5d40ee08 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:30.805353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-49773de0-ff19-4291-8704-1bad5d40ee08 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:30.813712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49773de0-ff19-4291-8704-1bad5d40ee08 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.814171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49773de0-ff19-4291-8704-1bad5d40ee08 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.815054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49773de0-ff19-4291-8704-1bad5d40ee08 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.815482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49773de0-ff19-4291-8704-1bad5d40ee08 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.906339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-49773de0-ff19-4291-8704-1bad5d40ee08 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:30.915537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-49773de0-ff19-4291-8704-1bad5d40ee08 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1242 microversion: 2.1 time: 0.114341 Dec 15 16:22:30.916397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 98/195] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1242 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:31.807235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1e448cb4-001e-4693-bdf5-f57e8efab160 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:31.807898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1e448cb4-001e-4693-bdf5-f57e8efab160 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:31.814713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e448cb4-001e-4693-bdf5-f57e8efab160 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:31.815189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e448cb4-001e-4693-bdf5-f57e8efab160 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:31.816052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e448cb4-001e-4693-bdf5-f57e8efab160 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:31.816497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e448cb4-001e-4693-bdf5-f57e8efab160 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:31.986375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1e448cb4-001e-4693-bdf5-f57e8efab160 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:31.994743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1e448cb4-001e-4693-bdf5-f57e8efab160 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.191283 Dec 15 16:22:31.995346 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 99/196] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:31 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:32.000283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-27ae6bb8-fe55-4bfc-9491-e9ee921bb19a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:32.001001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-27ae6bb8-fe55-4bfc-9491-e9ee921bb19a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:32.008055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27ae6bb8-fe55-4bfc-9491-e9ee921bb19a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:32.008908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27ae6bb8-fe55-4bfc-9491-e9ee921bb19a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:32.009921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27ae6bb8-fe55-4bfc-9491-e9ee921bb19a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:32.010516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27ae6bb8-fe55-4bfc-9491-e9ee921bb19a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:32.075180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-27ae6bb8-fe55-4bfc-9491-e9ee921bb19a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:32.083408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-27ae6bb8-fe55-4bfc-9491-e9ee921bb19a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1242 microversion: 2.1 time: 0.086923 Dec 15 16:22:32.083986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 100/197] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:32.183702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-90279fb2-f86e-48af-9ec5-f834c0603aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 28166 microversion: 2.20 time: 3.296905 Dec 15 16:22:32.184389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 98/198] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:28 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 28166 bytes in 3299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:33.023638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4c32a6af-9a2f-4316-930c-259a2d3369e6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:33.025202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4c32a6af-9a2f-4316-930c-259a2d3369e6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:33.038963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c32a6af-9a2f-4316-930c-259a2d3369e6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.039460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c32a6af-9a2f-4316-930c-259a2d3369e6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.040464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c32a6af-9a2f-4316-930c-259a2d3369e6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.041340 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c32a6af-9a2f-4316-930c-259a2d3369e6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.104622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b9b753bd-4a29-43c2-b1e2-aaa469111ffb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:33.104622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b9b753bd-4a29-43c2-b1e2-aaa469111ffb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:33.122964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9b753bd-4a29-43c2-b1e2-aaa469111ffb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.123987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9b753bd-4a29-43c2-b1e2-aaa469111ffb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.126941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9b753bd-4a29-43c2-b1e2-aaa469111ffb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.128934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9b753bd-4a29-43c2-b1e2-aaa469111ffb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.326730 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b9b753bd-4a29-43c2-b1e2-aaa469111ffb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:33.348050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b9b753bd-4a29-43c2-b1e2-aaa469111ffb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1296 microversion: 2.1 time: 0.249357 Dec 15 16:22:33.356792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 99/199] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:33 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1296 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:33.360614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bde47ff8-0c12-44c9-ad99-b070de432ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:33.363773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bde47ff8-0c12-44c9-ad99-b070de432ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:33.379090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bde47ff8-0c12-44c9-ad99-b070de432ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.379979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bde47ff8-0c12-44c9-ad99-b070de432ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.382250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bde47ff8-0c12-44c9-ad99-b070de432ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.383171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bde47ff8-0c12-44c9-ad99-b070de432ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.474011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4c32a6af-9a2f-4316-930c-259a2d3369e6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:33.496555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4c32a6af-9a2f-4316-930c-259a2d3369e6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.478099 Dec 15 16:22:33.497605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 101/200] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:33 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:33.512492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bde47ff8-0c12-44c9-ad99-b070de432ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 28166 microversion: 2.20 time: 0.158732 Dec 15 16:22:33.513985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 100/201] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:33 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 28166 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:34.381216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-84d6d75d-988c-4e4c-9cc7-b2d81f7cfa15 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:34.381940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-84d6d75d-988c-4e4c-9cc7-b2d81f7cfa15 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:34.393168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d6d75d-988c-4e4c-9cc7-b2d81f7cfa15 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.399959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d6d75d-988c-4e4c-9cc7-b2d81f7cfa15 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.401151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d6d75d-988c-4e4c-9cc7-b2d81f7cfa15 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.401624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d6d75d-988c-4e4c-9cc7-b2d81f7cfa15 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.525081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-68d3cfb4-1797-4800-8b07-3bace78d576f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:34.526233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-68d3cfb4-1797-4800-8b07-3bace78d576f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:34.543818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68d3cfb4-1797-4800-8b07-3bace78d576f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.544602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68d3cfb4-1797-4800-8b07-3bace78d576f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.545661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68d3cfb4-1797-4800-8b07-3bace78d576f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.546435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68d3cfb4-1797-4800-8b07-3bace78d576f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.877934 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-84d6d75d-988c-4e4c-9cc7-b2d81f7cfa15 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:34.888326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-84d6d75d-988c-4e4c-9cc7-b2d81f7cfa15 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1364 microversion: 2.1 time: 0.511266 Dec 15 16:22:34.891396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 102/202] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1364 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:34.906187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-666cfc98-bd60-40ad-915f-7930108667dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:34.908646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-666cfc98-bd60-40ad-915f-7930108667dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:34.918477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-666cfc98-bd60-40ad-915f-7930108667dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.919169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-666cfc98-bd60-40ad-915f-7930108667dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.920991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-666cfc98-bd60-40ad-915f-7930108667dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.921652 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-666cfc98-bd60-40ad-915f-7930108667dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.983696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-68d3cfb4-1797-4800-8b07-3bace78d576f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:34.994997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-68d3cfb4-1797-4800-8b07-3bace78d576f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.473907 Dec 15 16:22:35.001936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-666cfc98-bd60-40ad-915f-7930108667dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 28166 microversion: 2.20 time: 0.107512 Dec 15 16:22:35.003572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 103/203] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:34 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 28166 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:35.004070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 101/204] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:34 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:35.512739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-5e540a93-991d-4c8c-8982-de7e690e6192 req-b0e5b1b2-b14f-4c99-a41d-54f51f273cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58544761-395a-4b54-876b-38750b3d8cf1", "tag": "3d529e67-64e7-4ad6-8519-0a44d19e090e"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:35.521263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:35.521263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:22:35.560500 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-5e540a93-991d-4c8c-8982-de7e690e6192 req-b0e5b1b2-b14f-4c99-a41d-54f51f273cef service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:35.561898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-5e540a93-991d-4c8c-8982-de7e690e6192 req-b0e5b1b2-b14f-4c99-a41d-54f51f273cef service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:35.594410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-5e540a93-991d-4c8c-8982-de7e690e6192 req-b0e5b1b2-b14f-4c99-a41d-54f51f273cef service nova] Creating event network-changed:3d529e67-64e7-4ad6-8519-0a44d19e090e for instance 58544761-395a-4b54-876b-38750b3d8cf1 on hv-cinder-82002 Dec 15 16:22:35.607396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-5e540a93-991d-4c8c-8982-de7e690e6192 req-b0e5b1b2-b14f-4c99-a41d-54f51f273cef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120594 Dec 15 16:22:35.611150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 104/205] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:35.944079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-08071580-9cdf-4584-9f2b-ff39eb6fd5a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:35.947860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-08071580-9cdf-4584-9f2b-ff39eb6fd5a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:35.975547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-08071580-9cdf-4584-9f2b-ff39eb6fd5a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:35.975994 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-08071580-9cdf-4584-9f2b-ff39eb6fd5a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:35.978959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-08071580-9cdf-4584-9f2b-ff39eb6fd5a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:35.981228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-08071580-9cdf-4584-9f2b-ff39eb6fd5a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.031416 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c8edfc50-8b96-4dd7-a90a-81e6f259e6a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:36.039883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c8edfc50-8b96-4dd7-a90a-81e6f259e6a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:36.069794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8edfc50-8b96-4dd7-a90a-81e6f259e6a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.070582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8edfc50-8b96-4dd7-a90a-81e6f259e6a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.073452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8edfc50-8b96-4dd7-a90a-81e6f259e6a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.074228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8edfc50-8b96-4dd7-a90a-81e6f259e6a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.231171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c8edfc50-8b96-4dd7-a90a-81e6f259e6a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 28451 microversion: 2.20 time: 0.208650 Dec 15 16:22:36.232205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 105/206] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:36 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 28451 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:36.240969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9d62c3fe-8793-43c8-9353-4394711f7f9f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:36.242648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9d62c3fe-8793-43c8-9353-4394711f7f9f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:36.260588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d62c3fe-8793-43c8-9353-4394711f7f9f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.261296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d62c3fe-8793-43c8-9353-4394711f7f9f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.262297 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d62c3fe-8793-43c8-9353-4394711f7f9f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.263064 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d62c3fe-8793-43c8-9353-4394711f7f9f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.489408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-08071580-9cdf-4584-9f2b-ff39eb6fd5a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:36.517819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-08071580-9cdf-4584-9f2b-ff39eb6fd5a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1364 microversion: 2.1 time: 0.595337 Dec 15 16:22:36.518511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 102/207] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1364 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:36.633524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9d62c3fe-8793-43c8-9353-4394711f7f9f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:36.652572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9d62c3fe-8793-43c8-9353-4394711f7f9f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.417776 Dec 15 16:22:36.654069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 106/208] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:36 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:37.254023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5dda1dfc-baad-422a-b0d2-9203717263d6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:37.255919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5dda1dfc-baad-422a-b0d2-9203717263d6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:37.271085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5dda1dfc-baad-422a-b0d2-9203717263d6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.272646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5dda1dfc-baad-422a-b0d2-9203717263d6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.275300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5dda1dfc-baad-422a-b0d2-9203717263d6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.276420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5dda1dfc-baad-422a-b0d2-9203717263d6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.435398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5dda1dfc-baad-422a-b0d2-9203717263d6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 28619 microversion: 2.20 time: 0.193320 Dec 15 16:22:37.442104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 103/209] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:37 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 28619 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:22:37.540825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cb80da7d-38ca-4b5f-a171-945be655c254 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:37.542501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cb80da7d-38ca-4b5f-a171-945be655c254 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:37.554798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb80da7d-38ca-4b5f-a171-945be655c254 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.555954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb80da7d-38ca-4b5f-a171-945be655c254 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.557711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb80da7d-38ca-4b5f-a171-945be655c254 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.558507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb80da7d-38ca-4b5f-a171-945be655c254 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.673432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bd00f30e-3abd-4abf-9e4d-7e5c9f9cb3e1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:37.674336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bd00f30e-3abd-4abf-9e4d-7e5c9f9cb3e1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:37.695027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd00f30e-3abd-4abf-9e4d-7e5c9f9cb3e1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.695796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd00f30e-3abd-4abf-9e4d-7e5c9f9cb3e1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.696720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd00f30e-3abd-4abf-9e4d-7e5c9f9cb3e1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.697146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd00f30e-3abd-4abf-9e4d-7e5c9f9cb3e1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.852689 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cb80da7d-38ca-4b5f-a171-945be655c254 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:37.860865 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cb80da7d-38ca-4b5f-a171-945be655c254 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1364 microversion: 2.1 time: 0.328995 Dec 15 16:22:37.861463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 107/210] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:38.139509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bd00f30e-3abd-4abf-9e4d-7e5c9f9cb3e1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:38.150738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bd00f30e-3abd-4abf-9e4d-7e5c9f9cb3e1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.482263 Dec 15 16:22:38.152457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 104/211] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:37 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:38.455997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-26df89a7-4d35-4074-bdec-56293a6867bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:38.458559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-26df89a7-4d35-4074-bdec-56293a6867bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:38.474239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26df89a7-4d35-4074-bdec-56293a6867bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.474867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26df89a7-4d35-4074-bdec-56293a6867bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.476396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26df89a7-4d35-4074-bdec-56293a6867bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.477138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26df89a7-4d35-4074-bdec-56293a6867bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.585557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-26df89a7-4d35-4074-bdec-56293a6867bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 28619 microversion: 2.20 time: 0.138237 Dec 15 16:22:38.586746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 108/212] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:38 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 28619 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:38.891332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fd39c134-7ca3-4453-8a8f-5b8b069415ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:38.891997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fd39c134-7ca3-4453-8a8f-5b8b069415ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:38.904673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd39c134-7ca3-4453-8a8f-5b8b069415ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.905598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd39c134-7ca3-4453-8a8f-5b8b069415ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.906848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd39c134-7ca3-4453-8a8f-5b8b069415ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.907464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd39c134-7ca3-4453-8a8f-5b8b069415ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.182852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-926b3fab-6056-46cb-b774-13e21286212b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:39.184010 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-926b3fab-6056-46cb-b774-13e21286212b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:39.239813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-926b3fab-6056-46cb-b774-13e21286212b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:39.245673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-926b3fab-6056-46cb-b774-13e21286212b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.250036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-926b3fab-6056-46cb-b774-13e21286212b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:39.256395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-926b3fab-6056-46cb-b774-13e21286212b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.310303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fd39c134-7ca3-4453-8a8f-5b8b069415ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:39.392653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fd39c134-7ca3-4453-8a8f-5b8b069415ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1364 microversion: 2.1 time: 0.503284 Dec 15 16:22:39.393769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 105/213] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1364 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:39.603187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1072ca55-1ac7-40aa-8475-8da339118123 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:39.606808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1072ca55-1ac7-40aa-8475-8da339118123 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:39.620120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1072ca55-1ac7-40aa-8475-8da339118123 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:39.621299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1072ca55-1ac7-40aa-8475-8da339118123 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.623049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1072ca55-1ac7-40aa-8475-8da339118123 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:39.624155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1072ca55-1ac7-40aa-8475-8da339118123 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.740420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1072ca55-1ac7-40aa-8475-8da339118123 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 28619 microversion: 2.20 time: 0.142568 Dec 15 16:22:39.745809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 106/214] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:39 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 28619 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:22:39.989182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-926b3fab-6056-46cb-b774-13e21286212b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:40.007626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-926b3fab-6056-46cb-b774-13e21286212b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.832872 Dec 15 16:22:40.008217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 109/215] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:39 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:40.428506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c7a2d73e-df4b-42cd-9a99-d90523466e78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:40.429400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c7a2d73e-df4b-42cd-9a99-d90523466e78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:40.437610 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7a2d73e-df4b-42cd-9a99-d90523466e78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.438014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7a2d73e-df4b-42cd-9a99-d90523466e78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.439118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7a2d73e-df4b-42cd-9a99-d90523466e78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.439711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7a2d73e-df4b-42cd-9a99-d90523466e78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.719221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c7a2d73e-df4b-42cd-9a99-d90523466e78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:40.729579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c7a2d73e-df4b-42cd-9a99-d90523466e78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1364 microversion: 2.1 time: 0.306362 Dec 15 16:22:40.741979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 107/216] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:40.755844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dcb7e49a-ec83-4d03-b388-d1659fa244f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:40.757985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dcb7e49a-ec83-4d03-b388-d1659fa244f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:40.769133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dcb7e49a-ec83-4d03-b388-d1659fa244f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.769743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dcb7e49a-ec83-4d03-b388-d1659fa244f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.770906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dcb7e49a-ec83-4d03-b388-d1659fa244f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.771689 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dcb7e49a-ec83-4d03-b388-d1659fa244f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.857452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dcb7e49a-ec83-4d03-b388-d1659fa244f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 28619 microversion: 2.20 time: 0.106698 Dec 15 16:22:40.861712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 110/217] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:40 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 28619 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:41.040192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a396c58b-5c5c-4681-b54f-934d967922f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:41.056379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a396c58b-5c5c-4681-b54f-934d967922f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:41.079096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a396c58b-5c5c-4681-b54f-934d967922f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.079300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a396c58b-5c5c-4681-b54f-934d967922f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.084317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a396c58b-5c5c-4681-b54f-934d967922f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.086737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a396c58b-5c5c-4681-b54f-934d967922f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.308253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a396c58b-5c5c-4681-b54f-934d967922f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:41.317154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a396c58b-5c5c-4681-b54f-934d967922f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1522 microversion: 2.1 time: 0.283396 Dec 15 16:22:41.319339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 108/218] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:41 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:41.751441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-70255250-d113-4654-afcb-1f14f77ea509 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:41.753002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-70255250-d113-4654-afcb-1f14f77ea509 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:41.763676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70255250-d113-4654-afcb-1f14f77ea509 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.764276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70255250-d113-4654-afcb-1f14f77ea509 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.765174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70255250-d113-4654-afcb-1f14f77ea509 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.765853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70255250-d113-4654-afcb-1f14f77ea509 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.872180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e76882b5-a6ca-4a86-aa0c-209576d78a70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:41.874515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e76882b5-a6ca-4a86-aa0c-209576d78a70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:41.886273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e76882b5-a6ca-4a86-aa0c-209576d78a70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.886720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e76882b5-a6ca-4a86-aa0c-209576d78a70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.887534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e76882b5-a6ca-4a86-aa0c-209576d78a70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.887972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e76882b5-a6ca-4a86-aa0c-209576d78a70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.984096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e76882b5-a6ca-4a86-aa0c-209576d78a70 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 29341 microversion: 2.20 time: 0.117100 Dec 15 16:22:41.986629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 109/219] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:41 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 29341 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:42.036445 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-70255250-d113-4654-afcb-1f14f77ea509 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:42.045975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-70255250-d113-4654-afcb-1f14f77ea509 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1364 microversion: 2.1 time: 0.301371 Dec 15 16:22:42.048219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 111/220] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:42.319176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-ba8a7bb3-4905-4f3e-bfec-e2b3de8912e3 req-8d431689-6f14-4a49-a645-86b49690a1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58544761-395a-4b54-876b-38750b3d8cf1", "name": "network-vif-plugged", "status": "completed", "tag": "3d529e67-64e7-4ad6-8519-0a44d19e090e"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:42.321820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:42.321820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:22:42.348135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0e7c0a11-b60b-42d8-8ce8-048234572b4e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:42.349368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0e7c0a11-b60b-42d8-8ce8-048234572b4e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:42.355266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-ba8a7bb3-4905-4f3e-bfec-e2b3de8912e3 req-8d431689-6f14-4a49-a645-86b49690a1be service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:42.357586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-ba8a7bb3-4905-4f3e-bfec-e2b3de8912e3 req-8d431689-6f14-4a49-a645-86b49690a1be service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.370989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e7c0a11-b60b-42d8-8ce8-048234572b4e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:42.371430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e7c0a11-b60b-42d8-8ce8-048234572b4e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.376567 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e7c0a11-b60b-42d8-8ce8-048234572b4e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:42.380336 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e7c0a11-b60b-42d8-8ce8-048234572b4e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.402522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-ba8a7bb3-4905-4f3e-bfec-e2b3de8912e3 req-8d431689-6f14-4a49-a645-86b49690a1be service nova] Creating event network-vif-plugged:3d529e67-64e7-4ad6-8519-0a44d19e090e for instance 58544761-395a-4b54-876b-38750b3d8cf1 on hv-cinder-82002 Dec 15 16:22:42.410217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-ba8a7bb3-4905-4f3e-bfec-e2b3de8912e3 req-8d431689-6f14-4a49-a645-86b49690a1be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097104 Dec 15 16:22:42.415046 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 110/221] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:42.582248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0e7c0a11-b60b-42d8-8ce8-048234572b4e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:42.591775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0e7c0a11-b60b-42d8-8ce8-048234572b4e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1502 microversion: 2.1 time: 0.251195 Dec 15 16:22:42.611725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-63f9a958-c2cb-4f7e-9b0f-97cbfdecc9ff tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:42.613510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-63f9a958-c2cb-4f7e-9b0f-97cbfdecc9ff tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:42.616349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 112/222] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:42 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1502 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:42.624468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63f9a958-c2cb-4f7e-9b0f-97cbfdecc9ff tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:42.625140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63f9a958-c2cb-4f7e-9b0f-97cbfdecc9ff tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.626515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63f9a958-c2cb-4f7e-9b0f-97cbfdecc9ff tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:42.627382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63f9a958-c2cb-4f7e-9b0f-97cbfdecc9ff tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.909045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-63f9a958-c2cb-4f7e-9b0f-97cbfdecc9ff tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:42.922601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-63f9a958-c2cb-4f7e-9b0f-97cbfdecc9ff tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1516 microversion: 2.1 time: 0.315330 Dec 15 16:22:42.938868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 111/223] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:42 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1516 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:43.004774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-81571b7c-ee1b-4115-82dd-95e4ad8282fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:43.005840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-81571b7c-ee1b-4115-82dd-95e4ad8282fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:43.015843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81571b7c-ee1b-4115-82dd-95e4ad8282fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:43.016307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81571b7c-ee1b-4115-82dd-95e4ad8282fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:43.017621 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81571b7c-ee1b-4115-82dd-95e4ad8282fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:43.018150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81571b7c-ee1b-4115-82dd-95e4ad8282fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:43.082399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d2a8cf29-8201-4505-9eb6-6a2c490e71c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:43.083080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d2a8cf29-8201-4505-9eb6-6a2c490e71c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:43.091393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf29-8201-4505-9eb6-6a2c490e71c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:43.092069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf29-8201-4505-9eb6-6a2c490e71c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:43.093259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf29-8201-4505-9eb6-6a2c490e71c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:43.094023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d2a8cf29-8201-4505-9eb6-6a2c490e71c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:43.218232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-81571b7c-ee1b-4115-82dd-95e4ad8282fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 31387 microversion: 2.20 time: 0.223608 Dec 15 16:22:43.224296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 113/224] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:42 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 31387 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:43.400951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d2a8cf29-8201-4505-9eb6-6a2c490e71c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:43.415549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d2a8cf29-8201-4505-9eb6-6a2c490e71c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1364 microversion: 2.1 time: 0.339366 Dec 15 16:22:43.429354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 112/225] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1364 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:43.464086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1623307210", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:43.649116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.network.neutron [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] validate_networks() for None {{(pid=116022) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:22:44.237928 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1bccc751-9992-4b2f-86df-de931a952ea2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:44.239314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1bccc751-9992-4b2f-86df-de931a952ea2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:44.251411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1bccc751-9992-4b2f-86df-de931a952ea2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.252367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1bccc751-9992-4b2f-86df-de931a952ea2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.254022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1bccc751-9992-4b2f-86df-de931a952ea2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.254885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1bccc751-9992-4b2f-86df-de931a952ea2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.391254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1bccc751-9992-4b2f-86df-de931a952ea2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 32412 microversion: 2.20 time: 0.162620 Dec 15 16:22:44.391964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 113/226] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:44 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 32412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:22:44.448613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cb98ef68-1e70-4c97-8ddc-9004ac6d6bef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:44.449787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cb98ef68-1e70-4c97-8ddc-9004ac6d6bef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:44.461096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb98ef68-1e70-4c97-8ddc-9004ac6d6bef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.461958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb98ef68-1e70-4c97-8ddc-9004ac6d6bef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.463006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb98ef68-1e70-4c97-8ddc-9004ac6d6bef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.463690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb98ef68-1e70-4c97-8ddc-9004ac6d6bef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.501624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Flavor limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:22:44.502448 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Image limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:22:44.503211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Flavor pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:22:44.503692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Image pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:22:44.504139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:22:44.517131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.517580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.518632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.519027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.541678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Getting quotas for project 6f1dffc761a64825a00bef3099b17c89. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:22:44.548800 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Getting quotas for user d38e42db19b34675a217555e0982b9aa and project 6f1dffc761a64825a00bef3099b17c89. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:22:44.564468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Going to run 1 instances... {{(pid=116022) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:22:44.568028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:22:44.710642 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-07abaf1a-228d-4c1d-935e-fb2205f7bf0d tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257823 Dec 15 16:22:44.720730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 114/227] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:22:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:22:44.746252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6ef3b822-ec4b-4ccb-8a6d-b220671b3878 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:44.747150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6ef3b822-ec4b-4ccb-8a6d-b220671b3878 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:44.948972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6ef3b822-ec4b-4ccb-8a6d-b220671b3878 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:44.984662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6ef3b822-ec4b-4ccb-8a6d-b220671b3878 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1215 microversion: 2.1 time: 0.261330 Dec 15 16:22:44.988261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 115/228] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:44 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:45.034127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-815a6dde-a097-46ef-abad-7802cd99a601 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:45.036398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-815a6dde-a097-46ef-abad-7802cd99a601 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:45.050427 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-815a6dde-a097-46ef-abad-7802cd99a601 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.051223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-815a6dde-a097-46ef-abad-7802cd99a601 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.052900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-815a6dde-a097-46ef-abad-7802cd99a601 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.053723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-815a6dde-a097-46ef-abad-7802cd99a601 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.091321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-815a6dde-a097-46ef-abad-7802cd99a601 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lazy-loading 'flavor' on Instance uuid 7177930d-42eb-410e-a836-4287e9d78300 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:22:45.109338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cb98ef68-1e70-4c97-8ddc-9004ac6d6bef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:45.121159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cb98ef68-1e70-4c97-8ddc-9004ac6d6bef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1551 microversion: 2.1 time: 0.677902 Dec 15 16:22:45.122570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 114/229] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1551 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:45.141140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-284aa2cf-a846-4d75-9fc0-e3745b8df4be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:45.141824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-284aa2cf-a846-4d75-9fc0-e3745b8df4be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:45.192309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-284aa2cf-a846-4d75-9fc0-e3745b8df4be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.192309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-284aa2cf-a846-4d75-9fc0-e3745b8df4be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.194807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-284aa2cf-a846-4d75-9fc0-e3745b8df4be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.195764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-284aa2cf-a846-4d75-9fc0-e3745b8df4be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.396424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-815a6dde-a097-46ef-abad-7802cd99a601 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/action" status: 200 len: 32 microversion: 2.1 time: 0.404859 Dec 15 16:22:45.402756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 116/230] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:44 2021] POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/action => generated 32 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:45.432725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-864a4557-8378-43ec-adaa-ebed98261039 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:45.438831 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-864a4557-8378-43ec-adaa-ebed98261039 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:45.484122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-864a4557-8378-43ec-adaa-ebed98261039 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.485546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-864a4557-8378-43ec-adaa-ebed98261039 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.491008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-864a4557-8378-43ec-adaa-ebed98261039 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.494951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-864a4557-8378-43ec-adaa-ebed98261039 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.505199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-284aa2cf-a846-4d75-9fc0-e3745b8df4be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.368283 Dec 15 16:22:45.507605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 115/231] 10.222.0.30 () {58 vars in 1274 bytes} [Wed Dec 15 16:22:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-interface => generated 285 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:45.519982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6305b419-e155-4234-81fd-bf1f9a1ca2c3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:45.531541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6305b419-e155-4234-81fd-bf1f9a1ca2c3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:45.561148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6305b419-e155-4234-81fd-bf1f9a1ca2c3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.562457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6305b419-e155-4234-81fd-bf1f9a1ca2c3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.574220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6305b419-e155-4234-81fd-bf1f9a1ca2c3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.575681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6305b419-e155-4234-81fd-bf1f9a1ca2c3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.739109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-864a4557-8378-43ec-adaa-ebed98261039 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 33684 microversion: 2.20 time: 0.331184 Dec 15 16:22:45.740758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 117/232] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:45 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 33684 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:46.009331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cf5e0001-4d8e-4b79-a3fc-7875dff4543c tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:46.010436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cf5e0001-4d8e-4b79-a3fc-7875dff4543c tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:46.032058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf5e0001-4d8e-4b79-a3fc-7875dff4543c tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:46.032549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf5e0001-4d8e-4b79-a3fc-7875dff4543c tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:46.033598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf5e0001-4d8e-4b79-a3fc-7875dff4543c tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:46.034457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf5e0001-4d8e-4b79-a3fc-7875dff4543c tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:46.157709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cf5e0001-4d8e-4b79-a3fc-7875dff4543c tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:46.173747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cf5e0001-4d8e-4b79-a3fc-7875dff4543c tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1211 microversion: 2.1 time: 0.168344 Dec 15 16:22:46.174969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 118/233] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:46 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1211 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:46.649001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6305b419-e155-4234-81fd-bf1f9a1ca2c3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:46.668227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6305b419-e155-4234-81fd-bf1f9a1ca2c3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 1.158708 Dec 15 16:22:46.669717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 116/234] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:45 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:46.753600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f7d314b0-637b-48c7-9edc-5aca5ca2f359 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:46.757151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f7d314b0-637b-48c7-9edc-5aca5ca2f359 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:46.786481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7d314b0-637b-48c7-9edc-5aca5ca2f359 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:46.789198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7d314b0-637b-48c7-9edc-5aca5ca2f359 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:46.792790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7d314b0-637b-48c7-9edc-5aca5ca2f359 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:46.793658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7d314b0-637b-48c7-9edc-5aca5ca2f359 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:46.922995 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f7d314b0-637b-48c7-9edc-5aca5ca2f359 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 35246 microversion: 2.20 time: 0.173462 Dec 15 16:22:46.924590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 119/235] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:46 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 35246 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:47.200341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3f323550-89e7-4f8c-8532-2d7d42a475a1 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:47.202362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3f323550-89e7-4f8c-8532-2d7d42a475a1 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:47.216797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f323550-89e7-4f8c-8532-2d7d42a475a1 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.217916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f323550-89e7-4f8c-8532-2d7d42a475a1 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.219694 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f323550-89e7-4f8c-8532-2d7d42a475a1 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.220896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f323550-89e7-4f8c-8532-2d7d42a475a1 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.688940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-df038e5f-5c73-4239-a017-a447c80d190c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:47.689903 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-df038e5f-5c73-4239-a017-a447c80d190c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:47.701815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df038e5f-5c73-4239-a017-a447c80d190c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.702837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df038e5f-5c73-4239-a017-a447c80d190c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.703976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df038e5f-5c73-4239-a017-a447c80d190c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.704720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df038e5f-5c73-4239-a017-a447c80d190c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.730394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3f323550-89e7-4f8c-8532-2d7d42a475a1 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:47.747592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3f323550-89e7-4f8c-8532-2d7d42a475a1 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1273 microversion: 2.1 time: 0.557079 Dec 15 16:22:47.748827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 117/236] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:47 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1273 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:47.942755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bb14c505-b9d9-40d7-ac25-f67a598c665f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:47.947372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bb14c505-b9d9-40d7-ac25-f67a598c665f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:47.967669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bb14c505-b9d9-40d7-ac25-f67a598c665f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.971034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bb14c505-b9d9-40d7-ac25-f67a598c665f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.979774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bb14c505-b9d9-40d7-ac25-f67a598c665f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.982549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bb14c505-b9d9-40d7-ac25-f67a598c665f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:48.135641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bb14c505-b9d9-40d7-ac25-f67a598c665f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 36765 microversion: 2.20 time: 0.200402 Dec 15 16:22:48.149921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 118/237] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:47 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 36765 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:22:48.775757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-68f68c1f-48ed-4ff5-94a9-6a9856d911ea tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:48.779857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-68f68c1f-48ed-4ff5-94a9-6a9856d911ea tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:48.803623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68f68c1f-48ed-4ff5-94a9-6a9856d911ea tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:48.804336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68f68c1f-48ed-4ff5-94a9-6a9856d911ea tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:48.815920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68f68c1f-48ed-4ff5-94a9-6a9856d911ea tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:48.816935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68f68c1f-48ed-4ff5-94a9-6a9856d911ea tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:49.630591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-68f68c1f-48ed-4ff5-94a9-6a9856d911ea tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:49.653876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-68f68c1f-48ed-4ff5-94a9-6a9856d911ea tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1273 microversion: 2.1 time: 0.889960 Dec 15 16:22:49.660940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 119/238] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:48 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1273 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:49.674993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-05e697f8-d630-4d6a-9fbc-cad1332fdb3f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:49.685935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-df038e5f-5c73-4239-a017-a447c80d190c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:49.693457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-05e697f8-d630-4d6a-9fbc-cad1332fdb3f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:49.736194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-df038e5f-5c73-4239-a017-a447c80d190c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 2.048685 Dec 15 16:22:49.739982 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 120/239] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:47 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:49.740498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05e697f8-d630-4d6a-9fbc-cad1332fdb3f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:49.741981 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05e697f8-d630-4d6a-9fbc-cad1332fdb3f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:49.743801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05e697f8-d630-4d6a-9fbc-cad1332fdb3f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:49.745032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05e697f8-d630-4d6a-9fbc-cad1332fdb3f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:49.892392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-05e697f8-d630-4d6a-9fbc-cad1332fdb3f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 38176 microversion: 2.20 time: 0.229389 Dec 15 16:22:49.893085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 120/240] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:49 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 38176 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:50.691991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1fde48a8-cd99-436d-9ce4-ddc10e58aada tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:50.695368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1fde48a8-cd99-436d-9ce4-ddc10e58aada tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:50.710000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1fde48a8-cd99-436d-9ce4-ddc10e58aada tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:50.711190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1fde48a8-cd99-436d-9ce4-ddc10e58aada tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:50.713087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1fde48a8-cd99-436d-9ce4-ddc10e58aada tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:50.714334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1fde48a8-cd99-436d-9ce4-ddc10e58aada tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:50.783765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0b084400-8205-4ad1-9b3a-c03fdf85f617 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:50.800763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0b084400-8205-4ad1-9b3a-c03fdf85f617 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:50.834867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0b084400-8205-4ad1-9b3a-c03fdf85f617 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:50.838288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0b084400-8205-4ad1-9b3a-c03fdf85f617 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:50.841862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0b084400-8205-4ad1-9b3a-c03fdf85f617 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:50.844058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0b084400-8205-4ad1-9b3a-c03fdf85f617 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:51.425486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1fde48a8-cd99-436d-9ce4-ddc10e58aada tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:51.452041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1fde48a8-cd99-436d-9ce4-ddc10e58aada tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.776749 Dec 15 16:22:51.460959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 121/241] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:50 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:51.478557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3a85bf3e-0322-45cc-a8e7-e90cedb5672a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:51.481080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3a85bf3e-0322-45cc-a8e7-e90cedb5672a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:51.490359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0b084400-8205-4ad1-9b3a-c03fdf85f617 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:51.498703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0b084400-8205-4ad1-9b3a-c03fdf85f617 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.738300 Dec 15 16:22:51.499312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 121/242] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:50 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:51.504272 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a85bf3e-0322-45cc-a8e7-e90cedb5672a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:51.512986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a85bf3e-0322-45cc-a8e7-e90cedb5672a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:51.514910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a85bf3e-0322-45cc-a8e7-e90cedb5672a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:51.516024 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a85bf3e-0322-45cc-a8e7-e90cedb5672a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:51.517502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0c2875ba-35dc-41ee-a8ba-a1979ae20176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:51.518644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0c2875ba-35dc-41ee-a8ba-a1979ae20176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:51.543139 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c2875ba-35dc-41ee-a8ba-a1979ae20176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:51.543937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c2875ba-35dc-41ee-a8ba-a1979ae20176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:51.556127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c2875ba-35dc-41ee-a8ba-a1979ae20176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:51.557389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c2875ba-35dc-41ee-a8ba-a1979ae20176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:51.663734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3a85bf3e-0322-45cc-a8e7-e90cedb5672a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 38176 microversion: 2.20 time: 0.198988 Dec 15 16:22:51.665401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 122/243] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:51 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 38176 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:51.703458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0c2875ba-35dc-41ee-a8ba-a1979ae20176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 14 microversion: 2.1 time: 0.202815 Dec 15 16:22:51.704677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 122/244] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:51 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:51.712947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-6b4f2b91-3b12-45f7-a318-f5cbecda7616 req-ef85b916-dd81-44df-a798-dd8cbc5ddf43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58544761-395a-4b54-876b-38750b3d8cf1", "tag": "3d529e67-64e7-4ad6-8519-0a44d19e090e"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:51.719154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:51.719154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:22:51.753442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-6b4f2b91-3b12-45f7-a318-f5cbecda7616 req-ef85b916-dd81-44df-a798-dd8cbc5ddf43 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:51.755313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-6b4f2b91-3b12-45f7-a318-f5cbecda7616 req-ef85b916-dd81-44df-a798-dd8cbc5ddf43 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:51.786321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-6b4f2b91-3b12-45f7-a318-f5cbecda7616 req-ef85b916-dd81-44df-a798-dd8cbc5ddf43 service nova] Creating event network-changed:3d529e67-64e7-4ad6-8519-0a44d19e090e for instance 58544761-395a-4b54-876b-38750b3d8cf1 on hv-cinder-82002 Dec 15 16:22:51.796536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-6b4f2b91-3b12-45f7-a318-f5cbecda7616 req-ef85b916-dd81-44df-a798-dd8cbc5ddf43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127096 Dec 15 16:22:51.798697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 123/245] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:52.479904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-04a0e9e2-fd3f-4981-9e0b-b00ab493d5af tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:52.481011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-04a0e9e2-fd3f-4981-9e0b-b00ab493d5af tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:52.496190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-04a0e9e2-fd3f-4981-9e0b-b00ab493d5af tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:52.497268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-04a0e9e2-fd3f-4981-9e0b-b00ab493d5af tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:52.497514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-04a0e9e2-fd3f-4981-9e0b-b00ab493d5af tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:52.504551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-04a0e9e2-fd3f-4981-9e0b-b00ab493d5af tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:52.548470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-011e42c4-edc4-46ef-9887-6190f7894fb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:52.553109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-011e42c4-edc4-46ef-9887-6190f7894fb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:52.646248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-011e42c4-edc4-46ef-9887-6190f7894fb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:52.647071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-011e42c4-edc4-46ef-9887-6190f7894fb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:52.668692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-011e42c4-edc4-46ef-9887-6190f7894fb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:52.669509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-011e42c4-edc4-46ef-9887-6190f7894fb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:53.899174 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-04a0e9e2-fd3f-4981-9e0b-b00ab493d5af tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:53.904783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-011e42c4-edc4-46ef-9887-6190f7894fb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:53.928767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-011e42c4-edc4-46ef-9887-6190f7894fb9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 1.399093 Dec 15 16:22:53.934381 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 124/246] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:52 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:53.949437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-04a0e9e2-fd3f-4981-9e0b-b00ab493d5af tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 1.473213 Dec 15 16:22:53.953019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-81ad0785-7390-411f-a867-05b036ff3200 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:53.955160 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-81ad0785-7390-411f-a867-05b036ff3200 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:53.979590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 123/247] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:52 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:53.985394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-05fabcef-2bef-4f50-810c-f036284922cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:53.986378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-05fabcef-2bef-4f50-810c-f036284922cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:53.988153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81ad0785-7390-411f-a867-05b036ff3200 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:53.991613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81ad0785-7390-411f-a867-05b036ff3200 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:53.998946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81ad0785-7390-411f-a867-05b036ff3200 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:54.001398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81ad0785-7390-411f-a867-05b036ff3200 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:54.014695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05fabcef-2bef-4f50-810c-f036284922cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:54.015445 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05fabcef-2bef-4f50-810c-f036284922cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:54.016515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05fabcef-2bef-4f50-810c-f036284922cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:54.017146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05fabcef-2bef-4f50-810c-f036284922cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:55.359375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-81ad0785-7390-411f-a867-05b036ff3200 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 38319 microversion: 2.20 time: 1.422741 Dec 15 16:22:55.360262 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-05fabcef-2bef-4f50-810c-f036284922cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 14 microversion: 2.1 time: 1.379240 Dec 15 16:22:55.361047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 125/248] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:22:53 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 38319 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:55.367277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 124/249] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:53 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 14 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:55.367476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-5f6589a4-6210-4cba-917d-927b841a04b1 req-fbb0d6b8-064d-4a22-91a7-148ddd413d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84dbb049-5306-4117-889e-aa7324bc51b9", "tag": "ed67dd15-7cd6-44bd-8acb-3f8fcb6a8e83"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:55.371802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ddbd8959-09ad-4263-b295-5f80c677f936 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:55.372611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ddbd8959-09ad-4263-b295-5f80c677f936 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:55.377253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:55.377253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:22:55.390351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ddbd8959-09ad-4263-b295-5f80c677f936 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:55.390846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ddbd8959-09ad-4263-b295-5f80c677f936 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:55.391884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ddbd8959-09ad-4263-b295-5f80c677f936 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:55.392336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ddbd8959-09ad-4263-b295-5f80c677f936 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:55.396549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-5f6589a4-6210-4cba-917d-927b841a04b1 req-fbb0d6b8-064d-4a22-91a7-148ddd413d53 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:55.396549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-5f6589a4-6210-4cba-917d-927b841a04b1 req-fbb0d6b8-064d-4a22-91a7-148ddd413d53 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:55.439537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-5f6589a4-6210-4cba-917d-927b841a04b1 req-fbb0d6b8-064d-4a22-91a7-148ddd413d53 service nova] Creating event network-changed:ed67dd15-7cd6-44bd-8acb-3f8fcb6a8e83 for instance 84dbb049-5306-4117-889e-aa7324bc51b9 on hv-cinder-82002 Dec 15 16:22:55.458862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-5f6589a4-6210-4cba-917d-927b841a04b1 req-fbb0d6b8-064d-4a22-91a7-148ddd413d53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090226 Dec 15 16:22:55.461870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 126/250] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:55.477447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9efb3eef-dbd4-4b18-8fe2-bf08d89c8c78 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:55.480421 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9efb3eef-dbd4-4b18-8fe2-bf08d89c8c78 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:55.506625 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9efb3eef-dbd4-4b18-8fe2-bf08d89c8c78 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:55.509397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9efb3eef-dbd4-4b18-8fe2-bf08d89c8c78 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:55.510507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9efb3eef-dbd4-4b18-8fe2-bf08d89c8c78 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:55.516589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9efb3eef-dbd4-4b18-8fe2-bf08d89c8c78 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.243488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9efb3eef-dbd4-4b18-8fe2-bf08d89c8c78 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:56.259768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9efb3eef-dbd4-4b18-8fe2-bf08d89c8c78 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.796364 Dec 15 16:22:56.282375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 127/251] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:55 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:56.290143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ddbd8959-09ad-4263-b295-5f80c677f936 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:56.294093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-de1d3872-76b2-4c6d-8600-42b351853c1b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:56.295166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-de1d3872-76b2-4c6d-8600-42b351853c1b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:56.303637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ddbd8959-09ad-4263-b295-5f80c677f936 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.941170 Dec 15 16:22:56.304880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 125/252] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:55 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:56.320347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de1d3872-76b2-4c6d-8600-42b351853c1b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:56.321184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de1d3872-76b2-4c6d-8600-42b351853c1b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.322650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de1d3872-76b2-4c6d-8600-42b351853c1b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:56.325295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de1d3872-76b2-4c6d-8600-42b351853c1b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.374832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2ee61d6d-feb9-4912-85c4-77251adce6a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:56.375899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2ee61d6d-feb9-4912-85c4-77251adce6a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:56.385634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ee61d6d-feb9-4912-85c4-77251adce6a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:56.386450 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ee61d6d-feb9-4912-85c4-77251adce6a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.387586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ee61d6d-feb9-4912-85c4-77251adce6a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:56.388022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ee61d6d-feb9-4912-85c4-77251adce6a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.392122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-de1d3872-76b2-4c6d-8600-42b351853c1b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/ips" status: 200 len: 152 microversion: 2.20 time: 0.107855 Dec 15 16:22:56.402676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 128/253] 10.222.0.30 () {60 vars in 1288 bytes} [Wed Dec 15 16:22:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/ips => generated 152 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:57.288706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1529cff2-155a-4a43-89ca-d6c1ebeaa8d4 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:57.289984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1529cff2-155a-4a43-89ca-d6c1ebeaa8d4 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:57.302268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1529cff2-155a-4a43-89ca-d6c1ebeaa8d4 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:57.303454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1529cff2-155a-4a43-89ca-d6c1ebeaa8d4 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:57.305071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1529cff2-155a-4a43-89ca-d6c1ebeaa8d4 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:57.305792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1529cff2-155a-4a43-89ca-d6c1ebeaa8d4 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:57.665280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1529cff2-155a-4a43-89ca-d6c1ebeaa8d4 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:57.680077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1529cff2-155a-4a43-89ca-d6c1ebeaa8d4 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.397999 Dec 15 16:22:57.682341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 129/254] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:57 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:57.691485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f2015c0e-603f-4121-9bfa-1c60d2583edb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:57.693487 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f2015c0e-603f-4121-9bfa-1c60d2583edb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:57.705583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f2015c0e-603f-4121-9bfa-1c60d2583edb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:57.706765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f2015c0e-603f-4121-9bfa-1c60d2583edb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:57.708420 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f2015c0e-603f-4121-9bfa-1c60d2583edb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:57.709646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f2015c0e-603f-4121-9bfa-1c60d2583edb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:58.013342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f2015c0e-603f-4121-9bfa-1c60d2583edb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:58.036385 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f2015c0e-603f-4121-9bfa-1c60d2583edb tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.351866 Dec 15 16:22:58.037376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 130/255] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:57 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:58.701145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a02a00c0-8c74-428e-98fc-809117c71486 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:58.702924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a02a00c0-8c74-428e-98fc-809117c71486 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:58.713792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a02a00c0-8c74-428e-98fc-809117c71486 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:58.714219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a02a00c0-8c74-428e-98fc-809117c71486 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:58.715523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a02a00c0-8c74-428e-98fc-809117c71486 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:58.716555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a02a00c0-8c74-428e-98fc-809117c71486 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:59.076911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a02a00c0-8c74-428e-98fc-809117c71486 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:59.089853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a02a00c0-8c74-428e-98fc-809117c71486 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.394220 Dec 15 16:22:59.091064 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 131/256] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:58 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:59.099776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f555de19-22fe-46d2-8272-5ac690968b27 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:59.101153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f555de19-22fe-46d2-8272-5ac690968b27 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:59.141265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f555de19-22fe-46d2-8272-5ac690968b27 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:59.147167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f555de19-22fe-46d2-8272-5ac690968b27 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:59.149352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f555de19-22fe-46d2-8272-5ac690968b27 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:59.149949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f555de19-22fe-46d2-8272-5ac690968b27 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:59.238595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2ee61d6d-feb9-4912-85c4-77251adce6a3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 15064 microversion: 2.1 time: 2.867509 Dec 15 16:22:59.240780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 126/257] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:56 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 15064 bytes in 2871 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:23:00.113682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3e099815-633b-47cf-ac74-caf5b4773c33 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:00.114003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3e099815-633b-47cf-ac74-caf5b4773c33 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:00.129601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e099815-633b-47cf-ac74-caf5b4773c33 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:00.130049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e099815-633b-47cf-ac74-caf5b4773c33 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:00.137583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e099815-633b-47cf-ac74-caf5b4773c33 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:00.140801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e099815-633b-47cf-ac74-caf5b4773c33 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:00.770252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f555de19-22fe-46d2-8272-5ac690968b27 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:00.789761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f555de19-22fe-46d2-8272-5ac690968b27 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 1.696580 Dec 15 16:23:00.790733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 132/258] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:59 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:00.810330 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3d0b497c-ad5b-4d0e-96ff-d2ae4e5371ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:00.811192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3d0b497c-ad5b-4d0e-96ff-d2ae4e5371ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:00.823295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d0b497c-ad5b-4d0e-96ff-d2ae4e5371ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:00.823760 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d0b497c-ad5b-4d0e-96ff-d2ae4e5371ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:00.824627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d0b497c-ad5b-4d0e-96ff-d2ae4e5371ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:00.828528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d0b497c-ad5b-4d0e-96ff-d2ae4e5371ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:01.576003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3d0b497c-ad5b-4d0e-96ff-d2ae4e5371ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 19342 microversion: 2.1 time: 0.783762 Dec 15 16:23:01.583142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 133/259] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:00 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 19342 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:01.748191 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c9353d31-fde9-4c19-b5ed-ce23982e178d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:01.756227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c9353d31-fde9-4c19-b5ed-ce23982e178d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:01.802626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9353d31-fde9-4c19-b5ed-ce23982e178d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:01.806318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9353d31-fde9-4c19-b5ed-ce23982e178d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:01.811235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9353d31-fde9-4c19-b5ed-ce23982e178d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:01.814949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9353d31-fde9-4c19-b5ed-ce23982e178d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:01.931100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-c9353d31-fde9-4c19-b5ed-ce23982e178d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lazy-loading 'flavor' on Instance uuid 134cc886-afce-4a89-b875-cdf6768bfd8f {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:23:02.998057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c9353d31-fde9-4c19-b5ed-ce23982e178d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 202 len: 0 microversion: 2.20 time: 1.265841 Dec 15 16:23:03.012613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 134/260] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:23:01 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 0 bytes in 1285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:23:03.034788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8c3827df-9f35-453d-920d-18513c7e7748 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:03.043617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8c3827df-9f35-453d-920d-18513c7e7748 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:03.091052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c3827df-9f35-453d-920d-18513c7e7748 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:03.091841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c3827df-9f35-453d-920d-18513c7e7748 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:03.103638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c3827df-9f35-453d-920d-18513c7e7748 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:03.108919 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c3827df-9f35-453d-920d-18513c7e7748 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:03.364653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3e099815-633b-47cf-ac74-caf5b4773c33 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:03.392885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3e099815-633b-47cf-ac74-caf5b4773c33 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 3.287067 Dec 15 16:23:03.395171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 127/261] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:00 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 3291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:03.406674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3a7ccffe-1044-4da2-a6ec-635d6e4fcd44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:03.411305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3a7ccffe-1044-4da2-a6ec-635d6e4fcd44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:03.444261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a7ccffe-1044-4da2-a6ec-635d6e4fcd44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:03.447408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a7ccffe-1044-4da2-a6ec-635d6e4fcd44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:03.449253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a7ccffe-1044-4da2-a6ec-635d6e4fcd44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:03.450618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a7ccffe-1044-4da2-a6ec-635d6e4fcd44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:03.593303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3a7ccffe-1044-4da2-a6ec-635d6e4fcd44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 22717 microversion: 2.1 time: 0.195563 Dec 15 16:23:03.595246 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 128/262] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:03 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 22717 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:03.615551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:03.618117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:03.635322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:03.638934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:03.641428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:03.642728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:03.721092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8c3827df-9f35-453d-920d-18513c7e7748 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:03.734137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8c3827df-9f35-453d-920d-18513c7e7748 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.719433 Dec 15 16:23:03.734735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 135/263] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:03 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:04.182940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:04.191869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:04.197981 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:04.199624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-64d15db8-194d-4359-a2b8-c12f5af4ad5c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.601618 Dec 15 16:23:04.200729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 129/264] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:04.422602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0c25c542-8629-449b-83fc-5ede8a67f377 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:04.423242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0c25c542-8629-449b-83fc-5ede8a67f377 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:04.434324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c25c542-8629-449b-83fc-5ede8a67f377 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:04.434685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c25c542-8629-449b-83fc-5ede8a67f377 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:04.435522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c25c542-8629-449b-83fc-5ede8a67f377 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:04.435965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c25c542-8629-449b-83fc-5ede8a67f377 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:04.607874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-24425202-b874-454f-8d28-085057ae9324 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:04.608952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-24425202-b874-454f-8d28-085057ae9324 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:04.625789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24425202-b874-454f-8d28-085057ae9324 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:04.626242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24425202-b874-454f-8d28-085057ae9324 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:04.627298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24425202-b874-454f-8d28-085057ae9324 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:04.627804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24425202-b874-454f-8d28-085057ae9324 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:04.792471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-24425202-b874-454f-8d28-085057ae9324 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 23734 microversion: 2.1 time: 0.188469 Dec 15 16:23:04.798172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 130/265] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:04 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 23734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:04.805460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-27ebe448-9c6c-459c-9981-165b6982d895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:04.809511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-27ebe448-9c6c-459c-9981-165b6982d895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:04.839991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27ebe448-9c6c-459c-9981-165b6982d895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:04.841258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27ebe448-9c6c-459c-9981-165b6982d895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:04.846605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27ebe448-9c6c-459c-9981-165b6982d895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:04.849094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27ebe448-9c6c-459c-9981-165b6982d895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:05.018063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0c25c542-8629-449b-83fc-5ede8a67f377 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:05.030544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0c25c542-8629-449b-83fc-5ede8a67f377 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.613459 Dec 15 16:23:05.047563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 136/266] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:04 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:05.226668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:05.229493 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:05.241687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-27ebe448-9c6c-459c-9981-165b6982d895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:05.242695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:05.243461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:05.249583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:05.251822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:05.254072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-27ebe448-9c6c-459c-9981-165b6982d895 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.453046 Dec 15 16:23:05.255519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 131/267] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:04 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:05.600451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:05.620353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:05.624848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:05.627228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-20f27c47-85bc-482f-9084-b8f22748aab3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.407676 Dec 15 16:23:05.628544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 137/268] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:05.811194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-40576cb1-7f5d-48d6-b44d-0ed34105b585 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:05.814499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-40576cb1-7f5d-48d6-b44d-0ed34105b585 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:05.827895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40576cb1-7f5d-48d6-b44d-0ed34105b585 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:05.828824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40576cb1-7f5d-48d6-b44d-0ed34105b585 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:05.830341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40576cb1-7f5d-48d6-b44d-0ed34105b585 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:05.831630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40576cb1-7f5d-48d6-b44d-0ed34105b585 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:06.057960 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-75ec8ed7-c0be-4978-908b-9e613c793b5e tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:06.058822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-75ec8ed7-c0be-4978-908b-9e613c793b5e tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:06.066049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-75ec8ed7-c0be-4978-908b-9e613c793b5e tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:06.066492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-75ec8ed7-c0be-4978-908b-9e613c793b5e tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:06.067323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-75ec8ed7-c0be-4978-908b-9e613c793b5e tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:06.067756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-75ec8ed7-c0be-4978-908b-9e613c793b5e tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:06.254480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-75ec8ed7-c0be-4978-908b-9e613c793b5e tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:06.265355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-75ec8ed7-c0be-4978-908b-9e613c793b5e tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.211405 Dec 15 16:23:06.266321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 138/269] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:06 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:06.507991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4104c8ad-ec81-4aea-bde0-ef7ae6361744 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Action: 'create', calling method: .version_select at 0x7f3a7c3bc0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-281409665"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:06.528517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-4104c8ad-ec81-4aea-bde0-ef7ae6361744 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Getting quotas for project 6f8f838e6a4647859457e5560571a5ab. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:06.533485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-4104c8ad-ec81-4aea-bde0-ef7ae6361744 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Getting quotas for user 191079f41ac04162bcb5382c3e872f3c and project 6f8f838e6a4647859457e5560571a5ab. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:06.912883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-4104c8ad-ec81-4aea-bde0-ef7ae6361744 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Getting quotas for project 6f8f838e6a4647859457e5560571a5ab. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:06.921645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-4104c8ad-ec81-4aea-bde0-ef7ae6361744 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Getting quotas for user 191079f41ac04162bcb5382c3e872f3c and project 6f8f838e6a4647859457e5560571a5ab. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:06.947143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4104c8ad-ec81-4aea-bde0-ef7ae6361744 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.678843 Dec 15 16:23:06.954186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 139/270] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Dec 15 16:23:06 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:06.957628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-641fed49-6c1f-4214-941c-d241d309d6cf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:06.958347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-641fed49-6c1f-4214-941c-d241d309d6cf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:06.975143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-641fed49-6c1f-4214-941c-d241d309d6cf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:06.975143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-641fed49-6c1f-4214-941c-d241d309d6cf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:06.975143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-641fed49-6c1f-4214-941c-d241d309d6cf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:06.975805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-641fed49-6c1f-4214-941c-d241d309d6cf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:07.282312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-641fed49-6c1f-4214-941c-d241d309d6cf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:07.299054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-641fed49-6c1f-4214-941c-d241d309d6cf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.348536 Dec 15 16:23:07.309839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 140/271] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:06 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:07.309839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:07.311477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:07.323996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:07.324878 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:07.326514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:07.329081 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:07.610502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:07.629590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:07.633864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:07.636611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c9ecc7bc-7e9d-436d-b73e-a2faecb696b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.334030 Dec 15 16:23:07.644656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 141/272] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:07.656695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c86af388-d635-4e33-b638-48a59c76845f tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:07.658201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c86af388-d635-4e33-b638-48a59c76845f tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:07.671744 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c86af388-d635-4e33-b638-48a59c76845f tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:07.672522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c86af388-d635-4e33-b638-48a59c76845f tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:07.673826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c86af388-d635-4e33-b638-48a59c76845f tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:07.674278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c86af388-d635-4e33-b638-48a59c76845f tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:07.892153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c86af388-d635-4e33-b638-48a59c76845f tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:07.903377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c86af388-d635-4e33-b638-48a59c76845f tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.263498 Dec 15 16:23:07.903709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-40576cb1-7f5d-48d6-b44d-0ed34105b585 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 26310 microversion: 2.1 time: 2.100431 Dec 15 16:23:07.904579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 142/273] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:07 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:07.905454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 132/274] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:05 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 26310 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:08.322072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a1b02e11-19a2-4fe9-a788-ac8b6d1981f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:08.324793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a1b02e11-19a2-4fe9-a788-ac8b6d1981f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:08.350794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a1b02e11-19a2-4fe9-a788-ac8b6d1981f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:08.351714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a1b02e11-19a2-4fe9-a788-ac8b6d1981f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:08.353723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a1b02e11-19a2-4fe9-a788-ac8b6d1981f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:08.354920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a1b02e11-19a2-4fe9-a788-ac8b6d1981f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:08.666181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:08.668020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:08.687561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:08.688660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:08.690465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:08.691713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:08.817246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a1b02e11-19a2-4fe9-a788-ac8b6d1981f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:08.834151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a1b02e11-19a2-4fe9-a788-ac8b6d1981f7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.519590 Dec 15 16:23:08.835071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 143/275] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:08 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:08.918441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fbfafce7-a823-4025-94d1-a5c144ad69e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:08.919985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fbfafce7-a823-4025-94d1-a5c144ad69e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:08.930063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbfafce7-a823-4025-94d1-a5c144ad69e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:08.930686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbfafce7-a823-4025-94d1-a5c144ad69e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:08.931894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbfafce7-a823-4025-94d1-a5c144ad69e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:08.932548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbfafce7-a823-4025-94d1-a5c144ad69e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:09.046996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fbfafce7-a823-4025-94d1-a5c144ad69e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 27135 microversion: 2.1 time: 0.131942 Dec 15 16:23:09.052654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 144/276] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:08 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 27135 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:09.058806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9b518f63-13fb-443d-91bd-1ed32eed50b0 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:09.059811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9b518f63-13fb-443d-91bd-1ed32eed50b0 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:09.068394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9b518f63-13fb-443d-91bd-1ed32eed50b0 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:09.069401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9b518f63-13fb-443d-91bd-1ed32eed50b0 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:09.070499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9b518f63-13fb-443d-91bd-1ed32eed50b0 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:09.071206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9b518f63-13fb-443d-91bd-1ed32eed50b0 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:09.140252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:09.166606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:09.169801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:09.172199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-82e56ee8-0243-4f8e-b59f-b6a29d233b4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.517385 Dec 15 16:23:09.184420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 133/277] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:09.419261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9b518f63-13fb-443d-91bd-1ed32eed50b0 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:09.437977 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9b518f63-13fb-443d-91bd-1ed32eed50b0 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.383324 Dec 15 16:23:09.453343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 145/278] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:09 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:09.852872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5ce72453-72fa-4175-ada1-aaba1387fee3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:09.853771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5ce72453-72fa-4175-ada1-aaba1387fee3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:09.861526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ce72453-72fa-4175-ada1-aaba1387fee3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:09.862175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ce72453-72fa-4175-ada1-aaba1387fee3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:09.862986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ce72453-72fa-4175-ada1-aaba1387fee3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:09.863607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ce72453-72fa-4175-ada1-aaba1387fee3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.060136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7c952b88-43c0-4199-af12-6bf27b46105b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:10.061174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7c952b88-43c0-4199-af12-6bf27b46105b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:10.069649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c952b88-43c0-4199-af12-6bf27b46105b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.070095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c952b88-43c0-4199-af12-6bf27b46105b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.076231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c952b88-43c0-4199-af12-6bf27b46105b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.077321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c952b88-43c0-4199-af12-6bf27b46105b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.128765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5ce72453-72fa-4175-ada1-aaba1387fee3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:10.139685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5ce72453-72fa-4175-ada1-aaba1387fee3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.291535 Dec 15 16:23:10.151740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 134/279] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:09 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:10.215764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:10.216860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:10.225548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.226456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.227502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.228024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.260829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7c952b88-43c0-4199-af12-6bf27b46105b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 27719 microversion: 2.1 time: 0.204193 Dec 15 16:23:10.261670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 146/280] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:10 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 27719 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:10.470116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d5656c65-68df-4e45-b82a-09a818a55533 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:10.479718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d5656c65-68df-4e45-b82a-09a818a55533 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:10.507891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5656c65-68df-4e45-b82a-09a818a55533 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.508732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5656c65-68df-4e45-b82a-09a818a55533 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.510268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5656c65-68df-4e45-b82a-09a818a55533 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.511022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5656c65-68df-4e45-b82a-09a818a55533 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.561165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:10.575737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:10.577803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:10.579304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8d0af20b-c173-4be3-aab9-0e7233792d9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.368131 Dec 15 16:23:10.580009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 135/281] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:10.586707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-565adce3-64c7-4be0-b3f9-6670fe9cbaf7 req-ccd15497-e455-44bd-b3b5-c8236c8d145e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84dbb049-5306-4117-889e-aa7324bc51b9", "name": "network-vif-plugged", "status": "completed", "tag": "ed67dd15-7cd6-44bd-8acb-3f8fcb6a8e83"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:10.588905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:10.588905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:23:10.607196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-565adce3-64c7-4be0-b3f9-6670fe9cbaf7 req-ccd15497-e455-44bd-b3b5-c8236c8d145e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.608054 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-565adce3-64c7-4be0-b3f9-6670fe9cbaf7 req-ccd15497-e455-44bd-b3b5-c8236c8d145e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.641462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-565adce3-64c7-4be0-b3f9-6670fe9cbaf7 req-ccd15497-e455-44bd-b3b5-c8236c8d145e service nova] Creating event network-vif-plugged:ed67dd15-7cd6-44bd-8acb-3f8fcb6a8e83 for instance 84dbb049-5306-4117-889e-aa7324bc51b9 on hv-cinder-82002 Dec 15 16:23:10.650498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-565adce3-64c7-4be0-b3f9-6670fe9cbaf7 req-ccd15497-e455-44bd-b3b5-c8236c8d145e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068710 Dec 15 16:23:10.651535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 136/282] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:11.001899 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d5656c65-68df-4e45-b82a-09a818a55533 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:11.033535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d5656c65-68df-4e45-b82a-09a818a55533 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.568328 Dec 15 16:23:11.034950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 147/283] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:10 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:11.165163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-de0ff280-7a69-47b8-bc0e-57b158287eb6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:11.166518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-de0ff280-7a69-47b8-bc0e-57b158287eb6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:11.194911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de0ff280-7a69-47b8-bc0e-57b158287eb6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:11.195186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de0ff280-7a69-47b8-bc0e-57b158287eb6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:11.196728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de0ff280-7a69-47b8-bc0e-57b158287eb6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:11.197423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de0ff280-7a69-47b8-bc0e-57b158287eb6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:11.281571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-85cd2faf-7403-44e8-83e9-721720a4fd51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:11.283770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-85cd2faf-7403-44e8-83e9-721720a4fd51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:11.296112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-85cd2faf-7403-44e8-83e9-721720a4fd51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:11.297263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-85cd2faf-7403-44e8-83e9-721720a4fd51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:11.298828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-85cd2faf-7403-44e8-83e9-721720a4fd51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:11.299946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-85cd2faf-7403-44e8-83e9-721720a4fd51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:11.470520 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-de0ff280-7a69-47b8-bc0e-57b158287eb6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:11.482241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-de0ff280-7a69-47b8-bc0e-57b158287eb6 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.325343 Dec 15 16:23:11.483288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 137/284] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:11 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:11.614474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:11.615309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:11.627014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:11.628342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:11.630279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:11.631542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:11.673551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-85cd2faf-7403-44e8-83e9-721720a4fd51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28028 microversion: 2.1 time: 0.400864 Dec 15 16:23:11.681112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 148/285] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:11 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28028 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:11.907651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:11.927802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:11.931984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:11.935361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-52f124df-4279-4e2a-b215-398689fe2bcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.327633 Dec 15 16:23:11.936365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 138/286] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:12.062983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1a533140-c1ad-4bdd-9784-ce7dad0979b3 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:12.063679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1a533140-c1ad-4bdd-9784-ce7dad0979b3 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:12.072307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a533140-c1ad-4bdd-9784-ce7dad0979b3 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.072794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a533140-c1ad-4bdd-9784-ce7dad0979b3 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.073614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a533140-c1ad-4bdd-9784-ce7dad0979b3 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.074049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a533140-c1ad-4bdd-9784-ce7dad0979b3 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.250691 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1a533140-c1ad-4bdd-9784-ce7dad0979b3 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:12.260051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1a533140-c1ad-4bdd-9784-ce7dad0979b3 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1315 microversion: 2.1 time: 0.201152 Dec 15 16:23:12.260668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 149/287] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:12 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:12.505335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4f4cdb73-acd3-4884-a260-b4fc6e94f6b3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:12.505335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4f4cdb73-acd3-4884-a260-b4fc6e94f6b3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:12.511992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4f4cdb73-acd3-4884-a260-b4fc6e94f6b3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.512547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4f4cdb73-acd3-4884-a260-b4fc6e94f6b3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.513289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4f4cdb73-acd3-4884-a260-b4fc6e94f6b3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.513730 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4f4cdb73-acd3-4884-a260-b4fc6e94f6b3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.689370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2959d12e-290c-4411-b4ec-dafb726426d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:12.690193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2959d12e-290c-4411-b4ec-dafb726426d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:12.698686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2959d12e-290c-4411-b4ec-dafb726426d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.699131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2959d12e-290c-4411-b4ec-dafb726426d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.700170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2959d12e-290c-4411-b4ec-dafb726426d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.700836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2959d12e-290c-4411-b4ec-dafb726426d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.722774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4f4cdb73-acd3-4884-a260-b4fc6e94f6b3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:12.731216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4f4cdb73-acd3-4884-a260-b4fc6e94f6b3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.233452 Dec 15 16:23:12.732368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 139/288] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:12 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:12.845245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2959d12e-290c-4411-b4ec-dafb726426d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28196 microversion: 2.1 time: 0.159449 Dec 15 16:23:12.846143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 150/289] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:12 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28196 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:12.968729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:12.969907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:12.980063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.980891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.982734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.983707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.218810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:13.231021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:13.232967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:13.234537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f73c3a77-0acd-4ce0-a990-d4db14ed574e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.273833 Dec 15 16:23:13.248953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 140/290] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:13.280400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-840b4601-8dff-4f34-b84e-74d90e846838 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:13.281337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-840b4601-8dff-4f34-b84e-74d90e846838 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:13.291238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-840b4601-8dff-4f34-b84e-74d90e846838 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.291827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-840b4601-8dff-4f34-b84e-74d90e846838 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.292783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-840b4601-8dff-4f34-b84e-74d90e846838 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.293319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-840b4601-8dff-4f34-b84e-74d90e846838 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.483222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-840b4601-8dff-4f34-b84e-74d90e846838 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:13.491787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-840b4601-8dff-4f34-b84e-74d90e846838 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1464 microversion: 2.1 time: 0.215740 Dec 15 16:23:13.492480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 151/291] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:13 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:13.549252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9ea4272a-5381-4b3a-ae8b-65d0d53bb358 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:13.550136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9ea4272a-5381-4b3a-ae8b-65d0d53bb358 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:13.562020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ea4272a-5381-4b3a-ae8b-65d0d53bb358 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.562801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ea4272a-5381-4b3a-ae8b-65d0d53bb358 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.564273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ea4272a-5381-4b3a-ae8b-65d0d53bb358 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.565158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ea4272a-5381-4b3a-ae8b-65d0d53bb358 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.611251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9ea4272a-5381-4b3a-ae8b-65d0d53bb358 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:23:13.761091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-af31635c-cc0d-4e24-bde3-7b603866b4f1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:13.761916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-af31635c-cc0d-4e24-bde3-7b603866b4f1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:13.769594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af31635c-cc0d-4e24-bde3-7b603866b4f1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.770372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af31635c-cc0d-4e24-bde3-7b603866b4f1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.771610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af31635c-cc0d-4e24-bde3-7b603866b4f1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.772119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af31635c-cc0d-4e24-bde3-7b603866b4f1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.802814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9ea4272a-5381-4b3a-ae8b-65d0d53bb358 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "DELETE /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 204 len: 0 microversion: 2.1 time: 0.259767 Dec 15 16:23:13.803832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 141/292] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:23:13 2021] DELETE /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:23:13.817952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1ec0b07c-b944-4cd4-819f-4bf01d756142 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:13.819178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1ec0b07c-b944-4cd4-819f-4bf01d756142 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:13.831654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ec0b07c-b944-4cd4-819f-4bf01d756142 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.832663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ec0b07c-b944-4cd4-819f-4bf01d756142 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.834310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ec0b07c-b944-4cd4-819f-4bf01d756142 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.835268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ec0b07c-b944-4cd4-819f-4bf01d756142 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.027577 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-af31635c-cc0d-4e24-bde3-7b603866b4f1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:14.049525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-af31635c-cc0d-4e24-bde3-7b603866b4f1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1502 microversion: 2.1 time: 0.292449 Dec 15 16:23:14.052558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 152/293] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:13 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1502 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:14.069531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-64eab020-2683-4d01-820f-6034e735da16 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:14.071204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-64eab020-2683-4d01-820f-6034e735da16 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:14.086535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64eab020-2683-4d01-820f-6034e735da16 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.087332 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64eab020-2683-4d01-820f-6034e735da16 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.088807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64eab020-2683-4d01-820f-6034e735da16 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.089552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64eab020-2683-4d01-820f-6034e735da16 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.090783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1ec0b07c-b944-4cd4-819f-4bf01d756142 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:14.099202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1ec0b07c-b944-4cd4-819f-4bf01d756142 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1470 microversion: 2.1 time: 0.289823 Dec 15 16:23:14.099915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 142/294] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:13 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:14.105135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b59ec334-4965-4bd8-84db-be3aafaa598b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3ed97ae-d86e-4209-9487-432a6b9eac65"}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:14.106891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b59ec334-4965-4bd8-84db-be3aafaa598b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:14.114657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b59ec334-4965-4bd8-84db-be3aafaa598b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.115467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b59ec334-4965-4bd8-84db-be3aafaa598b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.116392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b59ec334-4965-4bd8-84db-be3aafaa598b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.117453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b59ec334-4965-4bd8-84db-be3aafaa598b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.153043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-b59ec334-4965-4bd8-84db-be3aafaa598b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] HTTP exception thrown: Cannot 'attach_volume' instance 7177930d-42eb-410e-a836-4287e9d78300 while it is in vm_state rescued Dec 15 16:23:14.154001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b59ec334-4965-4bd8-84db-be3aafaa598b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Returning 409 to user: Cannot 'attach_volume' instance 7177930d-42eb-410e-a836-4287e9d78300 while it is in vm_state rescued {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:23:14.154996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b59ec334-4965-4bd8-84db-be3aafaa598b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053797 Dec 15 16:23:14.155880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 143/295] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Dec 15 16:23:14 2021] POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 16:23:14.167201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-604c899e-0d53-4a3f-8530-d7d0b3f25161 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:14.167847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-604c899e-0d53-4a3f-8530-d7d0b3f25161 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:14.175472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-604c899e-0d53-4a3f-8530-d7d0b3f25161 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.176321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-604c899e-0d53-4a3f-8530-d7d0b3f25161 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.177312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-604c899e-0d53-4a3f-8530-d7d0b3f25161 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.177833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-604c899e-0d53-4a3f-8530-d7d0b3f25161 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.201687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-64eab020-2683-4d01-820f-6034e735da16 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28196 microversion: 2.1 time: 0.148151 Dec 15 16:23:14.203351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 153/296] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:14 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28196 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:14.261737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:14.263541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:14.267846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-604c899e-0d53-4a3f-8530-d7d0b3f25161 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/action" status: 202 len: 0 microversion: 2.1 time: 0.103943 Dec 15 16:23:14.269916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 144/297] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:14 2021] POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:23:14.278738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.280222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.282376 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1851f11a-973f-4424-bbe0-b8f33e5cb97e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:14.282840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.283087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1851f11a-973f-4424-bbe0-b8f33e5cb97e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:14.285306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.291144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1851f11a-973f-4424-bbe0-b8f33e5cb97e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.291596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1851f11a-973f-4424-bbe0-b8f33e5cb97e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.292959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1851f11a-973f-4424-bbe0-b8f33e5cb97e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.293630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1851f11a-973f-4424-bbe0-b8f33e5cb97e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.757068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:14.783655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1851f11a-973f-4424-bbe0-b8f33e5cb97e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:14.786566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:14.794541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:14.803571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e8dcdfa7-3f06-4846-b2db-aa6be5b3a43c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.547895 Dec 15 16:23:14.805188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1851f11a-973f-4424-bbe0-b8f33e5cb97e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1510 microversion: 2.1 time: 0.527750 Dec 15 16:23:14.807735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 145/298] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:14 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1510 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:14.812253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 154/299] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:15.143793 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-25f87046-18d4-49ef-93b2-d156bd27fa49 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:15.145437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-25f87046-18d4-49ef-93b2-d156bd27fa49 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:15.160308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25f87046-18d4-49ef-93b2-d156bd27fa49 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.161750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25f87046-18d4-49ef-93b2-d156bd27fa49 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.174307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25f87046-18d4-49ef-93b2-d156bd27fa49 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.175325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25f87046-18d4-49ef-93b2-d156bd27fa49 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.217550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5f358978-1c85-4198-a31c-e10b4808cf93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:15.218452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5f358978-1c85-4198-a31c-e10b4808cf93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:15.226812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f358978-1c85-4198-a31c-e10b4808cf93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.227645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f358978-1c85-4198-a31c-e10b4808cf93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.229539 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f358978-1c85-4198-a31c-e10b4808cf93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.230387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f358978-1c85-4198-a31c-e10b4808cf93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.372109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5f358978-1c85-4198-a31c-e10b4808cf93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28196 microversion: 2.1 time: 0.157520 Dec 15 16:23:15.380695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 155/300] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:15 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28196 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:15.753377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-25f87046-18d4-49ef-93b2-d156bd27fa49 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:15.763106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-25f87046-18d4-49ef-93b2-d156bd27fa49 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1470 microversion: 2.1 time: 0.631305 Dec 15 16:23:15.763699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 146/301] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:15 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1470 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:15.837243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-05618967-8063-4abb-9b9b-1373b291cd72 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:15.838980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-05618967-8063-4abb-9b9b-1373b291cd72 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:15.847286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:15.848669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:15.864768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05618967-8063-4abb-9b9b-1373b291cd72 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.866767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.867637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.868542 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05618967-8063-4abb-9b9b-1373b291cd72 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.869917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.870936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.871110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05618967-8063-4abb-9b9b-1373b291cd72 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.872570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05618967-8063-4abb-9b9b-1373b291cd72 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:16.106301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:16.125173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:16.126876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:16.128528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e5b41a4b-d010-4fc0-aa9b-aaf97e955000 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.290742 Dec 15 16:23:16.129585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 147/302] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:16.163141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-05618967-8063-4abb-9b9b-1373b291cd72 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:16.177473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-05618967-8063-4abb-9b9b-1373b291cd72 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1510 microversion: 2.1 time: 0.345614 Dec 15 16:23:16.178964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 156/303] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:15 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:16.394285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c04d06eb-7d5e-4c8a-8e76-ea30fe05c2d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:16.406620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c04d06eb-7d5e-4c8a-8e76-ea30fe05c2d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:16.431223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c04d06eb-7d5e-4c8a-8e76-ea30fe05c2d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:16.432170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c04d06eb-7d5e-4c8a-8e76-ea30fe05c2d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:16.433938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c04d06eb-7d5e-4c8a-8e76-ea30fe05c2d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:16.434710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c04d06eb-7d5e-4c8a-8e76-ea30fe05c2d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:16.562593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c04d06eb-7d5e-4c8a-8e76-ea30fe05c2d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28486 microversion: 2.1 time: 0.176569 Dec 15 16:23:16.563546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 148/304] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:16 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28486 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:16.782452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-61631df5-297f-4e98-95b1-ff1db6847571 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:16.783135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-61631df5-297f-4e98-95b1-ff1db6847571 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:16.795459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61631df5-297f-4e98-95b1-ff1db6847571 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:16.798267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61631df5-297f-4e98-95b1-ff1db6847571 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:16.799461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61631df5-297f-4e98-95b1-ff1db6847571 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:16.801835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61631df5-297f-4e98-95b1-ff1db6847571 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.123225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-61631df5-297f-4e98-95b1-ff1db6847571 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:17.132357 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-61631df5-297f-4e98-95b1-ff1db6847571 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1470 microversion: 2.1 time: 0.354374 Dec 15 16:23:17.153189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:17.154463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:17.156869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 157/305] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:16 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:17.201686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-abda242f-cd76-40c1-869d-8fe05f11ef3a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:17.202328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-abda242f-cd76-40c1-869d-8fe05f11ef3a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:17.208743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:17.209630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.210906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:17.212066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.216316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abda242f-cd76-40c1-869d-8fe05f11ef3a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:17.217135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abda242f-cd76-40c1-869d-8fe05f11ef3a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.218166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abda242f-cd76-40c1-869d-8fe05f11ef3a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:17.219489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abda242f-cd76-40c1-869d-8fe05f11ef3a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.718400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:17.730935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:17.733693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:17.735525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7f6fadff-77f4-4a25-a19e-c5d377c6a60c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.590298 Dec 15 16:23:17.736253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 149/306] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:17.755521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-d07e9784-063e-4ed9-a369-a936f3189c68 req-97be6527-8aec-49db-87a0-12f795c608af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84dbb049-5306-4117-889e-aa7324bc51b9", "name": "network-vif-deleted", "tag": "ed67dd15-7cd6-44bd-8acb-3f8fcb6a8e83"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:17.758169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:17.758169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:23:17.764624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-abda242f-cd76-40c1-869d-8fe05f11ef3a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:17.774272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-d07e9784-063e-4ed9-a369-a936f3189c68 req-97be6527-8aec-49db-87a0-12f795c608af service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:17.775318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-d07e9784-063e-4ed9-a369-a936f3189c68 req-97be6527-8aec-49db-87a0-12f795c608af service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.777581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-abda242f-cd76-40c1-869d-8fe05f11ef3a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1510 microversion: 2.1 time: 0.579466 Dec 15 16:23:17.778662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 158/307] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:17 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:17.789020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-87f0c1fc-380d-4013-8415-3391a00e2c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:17.790750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-87f0c1fc-380d-4013-8415-3391a00e2c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:17.802824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87f0c1fc-380d-4013-8415-3391a00e2c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:17.804052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87f0c1fc-380d-4013-8415-3391a00e2c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.805283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-d07e9784-063e-4ed9-a369-a936f3189c68 req-97be6527-8aec-49db-87a0-12f795c608af service nova] Creating event network-vif-deleted:ed67dd15-7cd6-44bd-8acb-3f8fcb6a8e83 for instance 84dbb049-5306-4117-889e-aa7324bc51b9 on hv-cinder-82002 Dec 15 16:23:17.805651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87f0c1fc-380d-4013-8415-3391a00e2c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:17.806438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87f0c1fc-380d-4013-8415-3391a00e2c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.814567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-d07e9784-063e-4ed9-a369-a936f3189c68 req-97be6527-8aec-49db-87a0-12f795c608af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075637 Dec 15 16:23:17.817283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 150/308] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:17.920725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-87f0c1fc-380d-4013-8415-3391a00e2c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28486 microversion: 2.1 time: 0.138977 Dec 15 16:23:17.921825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 159/309] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:17 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28486 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:18.158967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:18.161265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:18.183769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:18.184935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:18.186986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:18.188121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:18.374623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:18.376101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:18.382507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lazy-loading 'fault' on Instance uuid 84dbb049-5306-4117-889e-aa7324bc51b9 {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:23:18.543236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38e42db19b34675a217555e0982b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1dffc761a64825a00bef3099b17c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:18.573324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-88a782e4-1724-41eb-9ccf-f31e3ec46149 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 200 len: 1305 microversion: 2.1 time: 0.424659 Dec 15 16:23:18.576927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 151/310] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:18 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 1305 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:18.762240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:18.763125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:18.770704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:18.771151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:18.771958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:18.772391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:18.799405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-932c9a94-b1a0-4a11-8359-af8a1b719121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:18.800536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-932c9a94-b1a0-4a11-8359-af8a1b719121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:18.826927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-932c9a94-b1a0-4a11-8359-af8a1b719121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:18.827833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-932c9a94-b1a0-4a11-8359-af8a1b719121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:18.829856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-932c9a94-b1a0-4a11-8359-af8a1b719121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:18.831405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-932c9a94-b1a0-4a11-8359-af8a1b719121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:18.995838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:19.008165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:19.015466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:19.017971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2a5d93ea-8634-4721-9808-76ad390edc00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.260170 Dec 15 16:23:19.030363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 160/311] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:19.037186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-50cf2721-3b4e-476a-b253-c31f2ea0d000 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:19.039933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-50cf2721-3b4e-476a-b253-c31f2ea0d000 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:19.064963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50cf2721-3b4e-476a-b253-c31f2ea0d000 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:19.066543 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50cf2721-3b4e-476a-b253-c31f2ea0d000 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:19.068752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50cf2721-3b4e-476a-b253-c31f2ea0d000 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:19.076588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50cf2721-3b4e-476a-b253-c31f2ea0d000 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:19.153052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-932c9a94-b1a0-4a11-8359-af8a1b719121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:19.169971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-932c9a94-b1a0-4a11-8359-af8a1b719121 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1516 microversion: 2.1 time: 0.374698 Dec 15 16:23:19.185272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 152/312] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:18 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1516 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:19.197328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-50cf2721-3b4e-476a-b253-c31f2ea0d000 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28654 microversion: 2.1 time: 0.164437 Dec 15 16:23:19.198460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 161/313] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:19 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:19.597172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-06f939f3-c29f-4cfb-9e5a-9ab269aa1821 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:19.617551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-06f939f3-c29f-4cfb-9e5a-9ab269aa1821 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] [instance: 84dbb049-5306-4117-889e-aa7324bc51b9] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:19.629834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06f939f3-c29f-4cfb-9e5a-9ab269aa1821 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:19.631059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06f939f3-c29f-4cfb-9e5a-9ab269aa1821 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:19.632690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06f939f3-c29f-4cfb-9e5a-9ab269aa1821 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:19.633495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06f939f3-c29f-4cfb-9e5a-9ab269aa1821 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:19.669385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-06f939f3-c29f-4cfb-9e5a-9ab269aa1821 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] HTTP exception thrown: Instance 84dbb049-5306-4117-889e-aa7324bc51b9 could not be found. Dec 15 16:23:19.670800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-06f939f3-c29f-4cfb-9e5a-9ab269aa1821 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] Returning 404 to user: Instance 84dbb049-5306-4117-889e-aa7324bc51b9 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:23:19.673099 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-06f939f3-c29f-4cfb-9e5a-9ab269aa1821 tempest-VolumesNegativeTest-490366832 tempest-VolumesNegativeTest-490366832-project] 10.222.0.30 "GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9" status: 404 len: 111 microversion: 2.1 time: 0.084011 Dec 15 16:23:19.674944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 153/314] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:19 2021] GET /compute/v2.1/servers/84dbb049-5306-4117-889e-aa7324bc51b9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:23:20.041136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:20.042328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:20.054566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.055185 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.056615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.057500 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.214974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-32bede4e-b1a9-4b90-b527-0c0b7e5a5cf4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:20.216939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-32bede4e-b1a9-4b90-b527-0c0b7e5a5cf4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:20.228314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32bede4e-b1a9-4b90-b527-0c0b7e5a5cf4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.229364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32bede4e-b1a9-4b90-b527-0c0b7e5a5cf4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.231012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32bede4e-b1a9-4b90-b527-0c0b7e5a5cf4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.232344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32bede4e-b1a9-4b90-b527-0c0b7e5a5cf4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.333434 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:20.342416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-32bede4e-b1a9-4b90-b527-0c0b7e5a5cf4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28654 microversion: 2.1 time: 0.135938 Dec 15 16:23:20.348318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 154/315] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:20 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:23:20.356128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:20.359919 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:20.367171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7652f60b-f7b4-4be1-a7d6-4f2ef246622d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.328582 Dec 15 16:23:20.376966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 162/316] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:20.585645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-45245539", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "networks": [{"uuid": "0f2cb22b-70c8-4550-8ada-2ef9ecc0396f"}]}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:20.702931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.network.neutron [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] validate_networks() for [('0f2cb22b-70c8-4550-8ada-2ef9ecc0396f', None, None, None, None, None)] {{(pid=116021) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:23:20.787879 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eba062fa-e7ee-4b5b-889b-3711a07db1ee tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:20.788609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eba062fa-e7ee-4b5b-889b-3711a07db1ee tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:20.800848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eba062fa-e7ee-4b5b-889b-3711a07db1ee tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.804399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eba062fa-e7ee-4b5b-889b-3711a07db1ee tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.805312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eba062fa-e7ee-4b5b-889b-3711a07db1ee tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.805761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eba062fa-e7ee-4b5b-889b-3711a07db1ee tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.140469 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eba062fa-e7ee-4b5b-889b-3711a07db1ee tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:21.151960 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eba062fa-e7ee-4b5b-889b-3711a07db1ee tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1516 microversion: 2.1 time: 0.368361 Dec 15 16:23:21.152803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 163/317] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:20 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1516 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:21.187361 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cb2e5e93-2c36-4b68-b7bb-b6f8ac01e178 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31455c68-75e7-4fff-a12c-6edf1cacfb44"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:21.189575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cb2e5e93-2c36-4b68-b7bb-b6f8ac01e178 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:21.203584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb2e5e93-2c36-4b68-b7bb-b6f8ac01e178 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.204509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb2e5e93-2c36-4b68-b7bb-b6f8ac01e178 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.206406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb2e5e93-2c36-4b68-b7bb-b6f8ac01e178 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.207391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb2e5e93-2c36-4b68-b7bb-b6f8ac01e178 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.370503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Flavor limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:23:21.371063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Image limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:23:21.371527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Flavor pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:23:21.371943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Image pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:23:21.372350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:23:21.390684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.391255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.392161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.392860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.414696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Getting quotas for project 2ce9eb0396d945e692eb72ae3f344a66. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:21.421075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Getting quotas for user 525625cf3f3a4381a828f58b8ac056f3 and project 2ce9eb0396d945e692eb72ae3f344a66. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:21.445142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Going to run 1 instances... {{(pid=116021) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:23:21.448896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:23:21.537535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2cd51b37-caa3-4fc3-8f33-3956a6a2ee61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956924 Dec 15 16:23:21.551961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 155/318] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:23:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:23:21.551961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a31288a7-52b6-491b-bf43-2663787c75db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:21.553496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a31288a7-52b6-491b-bf43-2663787c75db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:21.576150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a31288a7-52b6-491b-bf43-2663787c75db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.594241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a31288a7-52b6-491b-bf43-2663787c75db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.595761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a31288a7-52b6-491b-bf43-2663787c75db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.601791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a31288a7-52b6-491b-bf43-2663787c75db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.652122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cb2e5e93-2c36-4b68-b7bb-b6f8ac01e178 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471465 Dec 15 16:23:21.656029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 164/319] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Dec 15 16:23:21 2021] POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:23:21.664757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:21.670910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:21.692739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.695735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.696671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.700144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.779792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a31288a7-52b6-491b-bf43-2663787c75db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28654 microversion: 2.1 time: 0.233533 Dec 15 16:23:21.781250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 156/320] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:21 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28654 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:21.806112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-116c36b2-2ab4-4277-9c04-14fae7f1116b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:21.811763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-116c36b2-2ab4-4277-9c04-14fae7f1116b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:21.987758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-116c36b2-2ab4-4277-9c04-14fae7f1116b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:22.040557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-116c36b2-2ab4-4277-9c04-14fae7f1116b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1217 microversion: 2.1 time: 0.256450 Dec 15 16:23:22.041594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 157/321] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:21 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1217 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:22.169476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:22.178876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:22.190734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:22.191976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ad501a7f-5a19-496a-87ee-e32c4c98164a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.533999 Dec 15 16:23:22.192586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 165/322] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:22.794571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2a2a9632-eff5-48ca-8f17-096ded656040 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:22.796147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2a2a9632-eff5-48ca-8f17-096ded656040 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:22.807008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2a2a9632-eff5-48ca-8f17-096ded656040 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:22.807756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2a2a9632-eff5-48ca-8f17-096ded656040 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:22.812957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2a2a9632-eff5-48ca-8f17-096ded656040 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:22.814016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2a2a9632-eff5-48ca-8f17-096ded656040 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:22.924665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2a2a9632-eff5-48ca-8f17-096ded656040 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 28773 microversion: 2.1 time: 0.135538 Dec 15 16:23:22.926260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 158/323] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:22 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 28773 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:23.068173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2c503d17-f17e-4f97-8eca-9b1be69f2348 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:23.068747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2c503d17-f17e-4f97-8eca-9b1be69f2348 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:23.075885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c503d17-f17e-4f97-8eca-9b1be69f2348 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:23.076827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c503d17-f17e-4f97-8eca-9b1be69f2348 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:23.077823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c503d17-f17e-4f97-8eca-9b1be69f2348 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:23.078438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c503d17-f17e-4f97-8eca-9b1be69f2348 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:23.222146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:23.224262 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:23.256684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:23.257713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:23.258661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:23.258839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2c503d17-f17e-4f97-8eca-9b1be69f2348 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:23.259877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:23.270973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2c503d17-f17e-4f97-8eca-9b1be69f2348 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1269 microversion: 2.1 time: 0.204912 Dec 15 16:23:23.271683 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 166/324] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:23 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1269 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:23.453807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:23.472614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:23.474450 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:23.475775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a8b66ea0-fa70-4102-b7e6-87911ed9a261 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1723 microversion: 2.20 time: 0.267212 Dec 15 16:23:23.476344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 159/325] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:23.944376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-56abd278-7956-41cb-938b-411438c16a53 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:23.946885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-56abd278-7956-41cb-938b-411438c16a53 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:23.960933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56abd278-7956-41cb-938b-411438c16a53 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:23.962878 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56abd278-7956-41cb-938b-411438c16a53 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:23.964814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56abd278-7956-41cb-938b-411438c16a53 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:23.966190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56abd278-7956-41cb-938b-411438c16a53 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:24.121833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-56abd278-7956-41cb-938b-411438c16a53 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 29992 microversion: 2.1 time: 0.164207 Dec 15 16:23:24.123798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 167/326] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:23 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 29992 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:24.290619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-368f9986-e892-4336-86d9-a96a9b97771f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:24.292192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-368f9986-e892-4336-86d9-a96a9b97771f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:24.307141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-368f9986-e892-4336-86d9-a96a9b97771f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:24.310916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-368f9986-e892-4336-86d9-a96a9b97771f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:24.311985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-368f9986-e892-4336-86d9-a96a9b97771f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:24.313984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-368f9986-e892-4336-86d9-a96a9b97771f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:24.441575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-79365608", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "networks": [{"uuid": "5688c779-4ca9-4a8a-9f7d-0ebc8aa55b8c"}]}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:24.583442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.network.neutron [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] validate_networks() for [('5688c779-4ca9-4a8a-9f7d-0ebc8aa55b8c', None, None, None, None, None)] {{(pid=116022) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:23:24.659241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-368f9986-e892-4336-86d9-a96a9b97771f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:24.679892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-368f9986-e892-4336-86d9-a96a9b97771f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1317 microversion: 2.1 time: 0.389666 Dec 15 16:23:24.684494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 160/327] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:24 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:24.695352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:24.705470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:24.721740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:24.722723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:24.724156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:24.727377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:25.162009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:25.184277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:25.188983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:25.192642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3cd288d5-1127-456f-9d64-6bd755957d39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1744 microversion: 2.20 time: 0.505683 Dec 15 16:23:25.193617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 161/328] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1744 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:25.218015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1b0264ee-e9ca-4940-bac5-b2a9208379e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:25.219870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1b0264ee-e9ca-4940-bac5-b2a9208379e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:25.231262 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b0264ee-e9ca-4940-bac5-b2a9208379e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:25.232299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b0264ee-e9ca-4940-bac5-b2a9208379e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:25.233830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b0264ee-e9ca-4940-bac5-b2a9208379e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:25.234571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b0264ee-e9ca-4940-bac5-b2a9208379e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:25.345899 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Flavor limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:23:25.346662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Image limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:23:25.347612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Flavor pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:23:25.348626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Image pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:23:25.349257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:23:25.368616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1b0264ee-e9ca-4940-bac5-b2a9208379e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 30964 microversion: 2.1 time: 0.172298 Dec 15 16:23:25.371019 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 162/329] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:25 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 30964 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:25.371822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:25.372695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:25.375019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:25.375811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:25.413325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Getting quotas for project c2df09e649444bf3bb3bc80331201c25. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:25.419752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Getting quotas for user ce7baeebd2974de2842369ccd0a588cb and project c2df09e649444bf3bb3bc80331201c25. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:25.433044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Going to run 1 instances... {{(pid=116022) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:23:25.435615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:23:25.487909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e52388c0-8251-436f-8865-7d12de2dd66a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051367 Dec 15 16:23:25.489388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 168/330] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:23:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:23:25.500601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-12c45600-a361-403d-b816-673683c78cc2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:25.501327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-12c45600-a361-403d-b816-673683c78cc2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:25.608464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-12c45600-a361-403d-b816-673683c78cc2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:25.617898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-12c45600-a361-403d-b816-673683c78cc2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1212 microversion: 2.1 time: 0.121850 Dec 15 16:23:25.619127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 163/331] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:25 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1212 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:25.646430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-b1c19a7c-e851-4d9f-bc33-527d4a16c77a req-fc69411f-bef1-4f87-a60a-ab606f6712f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02506a5c-6c61-442c-bedf-ffbe1dd23ff2", "tag": "08fcafa5-25ff-42a0-9063-587833cff4a1"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:25.649860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:25.649860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:23:25.666877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-b1c19a7c-e851-4d9f-bc33-527d4a16c77a req-fc69411f-bef1-4f87-a60a-ab606f6712f3 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:25.667783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-b1c19a7c-e851-4d9f-bc33-527d4a16c77a req-fc69411f-bef1-4f87-a60a-ab606f6712f3 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:25.708970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-b1c19a7c-e851-4d9f-bc33-527d4a16c77a req-fc69411f-bef1-4f87-a60a-ab606f6712f3 service nova] Creating event network-changed:08fcafa5-25ff-42a0-9063-587833cff4a1 for instance 02506a5c-6c61-442c-bedf-ffbe1dd23ff2 on hv-cinder-82002 Dec 15 16:23:25.719543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c79cd05b-9a7c-4cfb-8ed4-d5fddca75120 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:25.720681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-b1c19a7c-e851-4d9f-bc33-527d4a16c77a req-fc69411f-bef1-4f87-a60a-ab606f6712f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085445 Dec 15 16:23:25.721308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c79cd05b-9a7c-4cfb-8ed4-d5fddca75120 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:25.721935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 169/332] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:25.730833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c79cd05b-9a7c-4cfb-8ed4-d5fddca75120 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:25.731356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c79cd05b-9a7c-4cfb-8ed4-d5fddca75120 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:25.733091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c79cd05b-9a7c-4cfb-8ed4-d5fddca75120 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:25.733849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c79cd05b-9a7c-4cfb-8ed4-d5fddca75120 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:25.967477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c79cd05b-9a7c-4cfb-8ed4-d5fddca75120 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:25.983749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c79cd05b-9a7c-4cfb-8ed4-d5fddca75120 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1317 microversion: 2.1 time: 0.272730 Dec 15 16:23:25.984956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 164/333] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:25 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:26.226944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:26.228223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:26.257780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:26.259053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:26.262130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:26.263457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:26.386970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e8907be2-2dfa-41e4-9798-6fecee2e203d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:26.390257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e8907be2-2dfa-41e4-9798-6fecee2e203d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:26.410689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e8907be2-2dfa-41e4-9798-6fecee2e203d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:26.433047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e8907be2-2dfa-41e4-9798-6fecee2e203d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:26.445072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e8907be2-2dfa-41e4-9798-6fecee2e203d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:26.449576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e8907be2-2dfa-41e4-9798-6fecee2e203d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:26.609465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:26.624260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:26.626300 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:26.628687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ce5d0921-fac4-47b0-b381-5048b267c781 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1744 microversion: 2.20 time: 0.408880 Dec 15 16:23:26.647831 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 170/334] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1744 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:26.660596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e8907be2-2dfa-41e4-9798-6fecee2e203d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 32112 microversion: 2.1 time: 0.276913 Dec 15 16:23:26.668140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 165/335] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:26 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 32112 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:26.670608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d7e12ab8-6fea-4184-bd93-c177a80c19c8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:26.671262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d7e12ab8-6fea-4184-bd93-c177a80c19c8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:26.691668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7e12ab8-6fea-4184-bd93-c177a80c19c8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:26.693420 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7e12ab8-6fea-4184-bd93-c177a80c19c8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:26.695001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7e12ab8-6fea-4184-bd93-c177a80c19c8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:26.695761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7e12ab8-6fea-4184-bd93-c177a80c19c8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:26.859641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d7e12ab8-6fea-4184-bd93-c177a80c19c8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:26.874249 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d7e12ab8-6fea-4184-bd93-c177a80c19c8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1264 microversion: 2.1 time: 0.224754 Dec 15 16:23:26.874996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 171/336] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:26 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:27.012409 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-99b3c048-3aed-439a-8e8d-5f15581e2d57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:27.013876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-99b3c048-3aed-439a-8e8d-5f15581e2d57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:27.023116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b3c048-3aed-439a-8e8d-5f15581e2d57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.024074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b3c048-3aed-439a-8e8d-5f15581e2d57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.025118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b3c048-3aed-439a-8e8d-5f15581e2d57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.025725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b3c048-3aed-439a-8e8d-5f15581e2d57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.301853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-99b3c048-3aed-439a-8e8d-5f15581e2d57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:27.310728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-99b3c048-3aed-439a-8e8d-5f15581e2d57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1317 microversion: 2.1 time: 0.305227 Dec 15 16:23:27.323220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 166/337] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:27 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:27.655180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:27.657408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:27.693340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-11ddb660-1a74-47db-b4a5-258dd97d3c48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:27.697857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-11ddb660-1a74-47db-b4a5-258dd97d3c48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:27.721848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.726142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.733498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.736720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.742496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11ddb660-1a74-47db-b4a5-258dd97d3c48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.743406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11ddb660-1a74-47db-b4a5-258dd97d3c48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.746495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11ddb660-1a74-47db-b4a5-258dd97d3c48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.754822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11ddb660-1a74-47db-b4a5-258dd97d3c48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.922096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-11ddb660-1a74-47db-b4a5-258dd97d3c48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 33030 microversion: 2.1 time: 0.242260 Dec 15 16:23:27.923197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 167/338] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:27 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 33030 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:23:27.933283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e5e5d3b4-88e0-4d98-b7ef-0c34edc4e585 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:27.934477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5e5d3b4-88e0-4d98-b7ef-0c34edc4e585 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:27.953524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e5d3b4-88e0-4d98-b7ef-0c34edc4e585 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.955991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e5d3b4-88e0-4d98-b7ef-0c34edc4e585 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.958708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e5d3b4-88e0-4d98-b7ef-0c34edc4e585 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.962879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e5d3b4-88e0-4d98-b7ef-0c34edc4e585 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:28.286812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5e5d3b4-88e0-4d98-b7ef-0c34edc4e585 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:28.303371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e5e5d3b4-88e0-4d98-b7ef-0c34edc4e585 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1270 microversion: 2.1 time: 0.378671 Dec 15 16:23:28.309706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 168/339] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:27 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1270 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:28.337047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f9ddb5d7-fbd3-43cb-bbf7-0a5e761a17fc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:28.338835 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f9ddb5d7-fbd3-43cb-bbf7-0a5e761a17fc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:28.361479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9ddb5d7-fbd3-43cb-bbf7-0a5e761a17fc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:28.363673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9ddb5d7-fbd3-43cb-bbf7-0a5e761a17fc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:28.365644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9ddb5d7-fbd3-43cb-bbf7-0a5e761a17fc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:28.368937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9ddb5d7-fbd3-43cb-bbf7-0a5e761a17fc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:28.566362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:28.588508 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:28.594428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:28.596332 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8dd97f36-82f5-4fc2-ba67-0913d1441831 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1739 microversion: 2.20 time: 0.947305 Dec 15 16:23:28.612610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 172/340] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1739 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:28.742007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-9f0a4685-30e1-4e46-b762-1c0a380175ee req-c50fb096-47ef-4f07-8798-654156b8c877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134cc886-afce-4a89-b875-cdf6768bfd8f", "name": "network-vif-plugged", "status": "completed", "tag": "9b8f6012-13ef-4292-8d62-47854410ace5"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:28.744095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:28.744095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:23:28.769466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-9f0a4685-30e1-4e46-b762-1c0a380175ee req-c50fb096-47ef-4f07-8798-654156b8c877 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:28.770173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-9f0a4685-30e1-4e46-b762-1c0a380175ee req-c50fb096-47ef-4f07-8798-654156b8c877 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:28.789091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f9ddb5d7-fbd3-43cb-bbf7-0a5e761a17fc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:28.798679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f9ddb5d7-fbd3-43cb-bbf7-0a5e761a17fc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1317 microversion: 2.1 time: 0.471002 Dec 15 16:23:28.801737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-9f0a4685-30e1-4e46-b762-1c0a380175ee req-c50fb096-47ef-4f07-8798-654156b8c877 service nova] Creating event network-vif-plugged:9b8f6012-13ef-4292-8d62-47854410ace5 for instance 134cc886-afce-4a89-b875-cdf6768bfd8f on hv-cinder-82002 Dec 15 16:23:28.802006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 169/341] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:28 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:28.813672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-9f0a4685-30e1-4e46-b762-1c0a380175ee req-c50fb096-47ef-4f07-8798-654156b8c877 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076887 Dec 15 16:23:28.814717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 173/342] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:23:28.935567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7b262332-66fc-4d9b-b20b-647e10f68b3a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:28.937059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7b262332-66fc-4d9b-b20b-647e10f68b3a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:28.944934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b262332-66fc-4d9b-b20b-647e10f68b3a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:28.945771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b262332-66fc-4d9b-b20b-647e10f68b3a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:28.946628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b262332-66fc-4d9b-b20b-647e10f68b3a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:28.947065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b262332-66fc-4d9b-b20b-647e10f68b3a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:29.060847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7b262332-66fc-4d9b-b20b-647e10f68b3a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 33668 microversion: 2.1 time: 0.128445 Dec 15 16:23:29.064497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 170/343] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:28 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 33668 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:23:29.329378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aae0ee80-ea2e-423c-83c5-141ed89c2bf3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:29.330648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aae0ee80-ea2e-423c-83c5-141ed89c2bf3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:29.337789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aae0ee80-ea2e-423c-83c5-141ed89c2bf3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:29.338230 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aae0ee80-ea2e-423c-83c5-141ed89c2bf3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:29.339254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aae0ee80-ea2e-423c-83c5-141ed89c2bf3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:29.339687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aae0ee80-ea2e-423c-83c5-141ed89c2bf3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:29.635204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:29.646247 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:29.667055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:29.667827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:29.669290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:29.670867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:30.436065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aae0ee80-ea2e-423c-83c5-141ed89c2bf3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:30.449817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aae0ee80-ea2e-423c-83c5-141ed89c2bf3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 1.124734 Dec 15 16:23:30.450529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 174/344] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:29 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:30.461239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dddf53fd-ae79-4497-b3e4-82527a27fe1a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:30.463232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dddf53fd-ae79-4497-b3e4-82527a27fe1a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:30.482834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dddf53fd-ae79-4497-b3e4-82527a27fe1a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:30.484050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dddf53fd-ae79-4497-b3e4-82527a27fe1a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:30.485783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dddf53fd-ae79-4497-b3e4-82527a27fe1a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:30.486835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dddf53fd-ae79-4497-b3e4-82527a27fe1a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:30.542408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:30.556045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:30.559451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:30.564367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-26a0ac2f-68a3-474f-9ce8-6346e7914be9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1739 microversion: 2.20 time: 0.941262 Dec 15 16:23:30.565745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 171/345] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1739 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:30.579062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-dddf53fd-ae79-4497-b3e4-82527a27fe1a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lazy-loading 'flavor' on Instance uuid 7177930d-42eb-410e-a836-4287e9d78300 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:23:30.581041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c034286a-4275-454e-b43f-569a52cec89e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:30.581911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c034286a-4275-454e-b43f-569a52cec89e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:30.610439 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c034286a-4275-454e-b43f-569a52cec89e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:30.610885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c034286a-4275-454e-b43f-569a52cec89e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:30.611918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c034286a-4275-454e-b43f-569a52cec89e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:30.612618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c034286a-4275-454e-b43f-569a52cec89e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:30.898238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dddf53fd-ae79-4497-b3e4-82527a27fe1a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/action" status: 200 len: 32 microversion: 2.1 time: 0.445014 Dec 15 16:23:30.906694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 175/346] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:30 2021] POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/action => generated 32 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:23:30.918147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-82cff7d4-8a01-4360-85d3-1bf069cf7c5e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:30.919801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-82cff7d4-8a01-4360-85d3-1bf069cf7c5e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:30.933255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82cff7d4-8a01-4360-85d3-1bf069cf7c5e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:30.934161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82cff7d4-8a01-4360-85d3-1bf069cf7c5e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:30.935268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82cff7d4-8a01-4360-85d3-1bf069cf7c5e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:30.935869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82cff7d4-8a01-4360-85d3-1bf069cf7c5e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:31.024329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c034286a-4275-454e-b43f-569a52cec89e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:31.034447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c034286a-4275-454e-b43f-569a52cec89e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1317 microversion: 2.1 time: 0.465313 Dec 15 16:23:31.038500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 172/347] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:30 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:31.044342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b7b4c44e-a9be-4861-b232-17a9ab00335c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:31.047497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b7b4c44e-a9be-4861-b232-17a9ab00335c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:31.058350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7b4c44e-a9be-4861-b232-17a9ab00335c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:31.058975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7b4c44e-a9be-4861-b232-17a9ab00335c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:31.060270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7b4c44e-a9be-4861-b232-17a9ab00335c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:31.060883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7b4c44e-a9be-4861-b232-17a9ab00335c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:31.065247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-82cff7d4-8a01-4360-85d3-1bf069cf7c5e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 34654 microversion: 2.1 time: 0.154953 Dec 15 16:23:31.066742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 176/348] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:30 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 34654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:31.135282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-490b232a-c212-4366-98e6-d2b888aa7611 req-266d3424-8475-4f6b-af57-8170e18a1419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137d6291-391b-4c93-8ed1-dd2dcb656e91", "tag": "e8280a72-286e-4a04-81c8-a6c7e1391550"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:31.138113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:31.138113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:23:31.152119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-490b232a-c212-4366-98e6-d2b888aa7611 req-266d3424-8475-4f6b-af57-8170e18a1419 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:31.153035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-490b232a-c212-4366-98e6-d2b888aa7611 req-266d3424-8475-4f6b-af57-8170e18a1419 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:31.171159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-490b232a-c212-4366-98e6-d2b888aa7611 req-266d3424-8475-4f6b-af57-8170e18a1419 service nova] Creating event network-changed:e8280a72-286e-4a04-81c8-a6c7e1391550 for instance 137d6291-391b-4c93-8ed1-dd2dcb656e91 on hv-cinder-82002 Dec 15 16:23:31.177473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-490b232a-c212-4366-98e6-d2b888aa7611 req-266d3424-8475-4f6b-af57-8170e18a1419 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048605 Dec 15 16:23:31.178831 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 177/349] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:31.395343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b7b4c44e-a9be-4861-b232-17a9ab00335c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:31.411109 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b7b4c44e-a9be-4861-b232-17a9ab00335c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.370510 Dec 15 16:23:31.411720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 173/350] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:31 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:31.468386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0ea55b81-1e0e-434d-87a4-09501bd1ffbd tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:31.470064 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0ea55b81-1e0e-434d-87a4-09501bd1ffbd tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:31.490061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ea55b81-1e0e-434d-87a4-09501bd1ffbd tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:31.490685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ea55b81-1e0e-434d-87a4-09501bd1ffbd tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:31.494614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ea55b81-1e0e-434d-87a4-09501bd1ffbd tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:31.495255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ea55b81-1e0e-434d-87a4-09501bd1ffbd tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:31.599702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:31.601387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:31.622635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:31.625932 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:31.627155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:31.628789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:32.119599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0ea55b81-1e0e-434d-87a4-09501bd1ffbd tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:32.129112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0ea55b81-1e0e-434d-87a4-09501bd1ffbd tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 0.664947 Dec 15 16:23:32.130087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 178/351] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:31 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:32.132533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:32.143787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0a6a8861-aa95-41c9-93c9-e8a0ff9a1e27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:32.144822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0a6a8861-aa95-41c9-93c9-e8a0ff9a1e27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:32.156002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:32.157074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0a6a8861-aa95-41c9-93c9-e8a0ff9a1e27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:32.158006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0a6a8861-aa95-41c9-93c9-e8a0ff9a1e27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:32.158306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:32.159611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0a6a8861-aa95-41c9-93c9-e8a0ff9a1e27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:32.160410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0a6a8861-aa95-41c9-93c9-e8a0ff9a1e27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:32.163324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1aa14c3d-f1ac-4782-80b8-6bbf51790094 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1739 microversion: 2.20 time: 0.565044 Dec 15 16:23:32.164381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 174/352] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1739 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:32.178330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5e8e7e26-52dc-4e42-86fb-bd52efec70d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:32.182280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5e8e7e26-52dc-4e42-86fb-bd52efec70d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:32.196963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e8e7e26-52dc-4e42-86fb-bd52efec70d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:32.197962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e8e7e26-52dc-4e42-86fb-bd52efec70d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:32.199331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e8e7e26-52dc-4e42-86fb-bd52efec70d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:32.200658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e8e7e26-52dc-4e42-86fb-bd52efec70d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:32.352451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5e8e7e26-52dc-4e42-86fb-bd52efec70d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 35277 microversion: 2.1 time: 0.185990 Dec 15 16:23:32.358270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 175/353] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:32 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 35277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:32.429879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a345eac9-6610-4eef-a1d3-0977591547f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:32.430592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a345eac9-6610-4eef-a1d3-0977591547f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:32.439148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a345eac9-6610-4eef-a1d3-0977591547f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:32.439463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a345eac9-6610-4eef-a1d3-0977591547f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:32.440286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a345eac9-6610-4eef-a1d3-0977591547f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:32.440825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a345eac9-6610-4eef-a1d3-0977591547f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:32.577843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0a6a8861-aa95-41c9-93c9-e8a0ff9a1e27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:32.587049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0a6a8861-aa95-41c9-93c9-e8a0ff9a1e27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1317 microversion: 2.1 time: 0.455536 Dec 15 16:23:32.587999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 179/354] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:32 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:32.822127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a345eac9-6610-4eef-a1d3-0977591547f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:32.844233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a345eac9-6610-4eef-a1d3-0977591547f8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.418601 Dec 15 16:23:32.845331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 176/355] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:32 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:33.154473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0ffb9fbb-adf0-45d8-af17-f023bcf9f67f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:33.156353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0ffb9fbb-adf0-45d8-af17-f023bcf9f67f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:33.167333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ffb9fbb-adf0-45d8-af17-f023bcf9f67f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.168759 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ffb9fbb-adf0-45d8-af17-f023bcf9f67f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.170937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ffb9fbb-adf0-45d8-af17-f023bcf9f67f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.172198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ffb9fbb-adf0-45d8-af17-f023bcf9f67f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.195889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:33.200890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:33.211915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.212319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.218076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.218904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.444995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:33.459664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0ffb9fbb-adf0-45d8-af17-f023bcf9f67f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:33.474493 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0ffb9fbb-adf0-45d8-af17-f023bcf9f67f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 0.327724 Dec 15 16:23:33.476490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 180/356] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:33 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:33.484099 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:33.487568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:33.489295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bff55b87-bede-4f7e-89ae-08019e09a930 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:33.489773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d42b2eff-89be-4497-b3d3-2e52759506dc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1739 microversion: 2.20 time: 0.297455 Dec 15 16:23:33.490839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bff55b87-bede-4f7e-89ae-08019e09a930 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:33.492354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 177/357] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:33.500861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bff55b87-bede-4f7e-89ae-08019e09a930 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.502265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bff55b87-bede-4f7e-89ae-08019e09a930 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.504008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bff55b87-bede-4f7e-89ae-08019e09a930 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.504783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bff55b87-bede-4f7e-89ae-08019e09a930 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.606743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f079758f-aff2-47d2-91b6-5479983392f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:33.608033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f079758f-aff2-47d2-91b6-5479983392f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:33.617767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bff55b87-bede-4f7e-89ae-08019e09a930 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 35907 microversion: 2.1 time: 0.137811 Dec 15 16:23:33.618590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f079758f-aff2-47d2-91b6-5479983392f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.620014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f079758f-aff2-47d2-91b6-5479983392f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.621686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f079758f-aff2-47d2-91b6-5479983392f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.622387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 181/358] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:33 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 35907 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:33.622551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f079758f-aff2-47d2-91b6-5479983392f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.833354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f079758f-aff2-47d2-91b6-5479983392f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:33.845666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f079758f-aff2-47d2-91b6-5479983392f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1317 microversion: 2.1 time: 0.245251 Dec 15 16:23:33.846631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 178/359] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:33 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:33.870529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cba0d482-fdeb-42cc-8ff2-b27edbc2b7b9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:33.871289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cba0d482-fdeb-42cc-8ff2-b27edbc2b7b9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:33.881973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cba0d482-fdeb-42cc-8ff2-b27edbc2b7b9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.882476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cba0d482-fdeb-42cc-8ff2-b27edbc2b7b9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.883240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cba0d482-fdeb-42cc-8ff2-b27edbc2b7b9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.883719 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cba0d482-fdeb-42cc-8ff2-b27edbc2b7b9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.998096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-838966437", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-281409665", "security_groups": [{"name": "tempest-secgroup-smoke-673056979"}], "networks": [{"uuid": "950e15b8-9462-491e-9b7f-69d860b22eca"}], "block_device_mapping_v2": [{"uuid": "477ef1ba-dfe7-4605-81ba-610c9f58920d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:34.102376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cba0d482-fdeb-42cc-8ff2-b27edbc2b7b9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:34.112673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cba0d482-fdeb-42cc-8ff2-b27edbc2b7b9 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.246245 Dec 15 16:23:34.126164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 182/360] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:33 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:34.201975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.network.neutron [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] validate_networks() for [('950e15b8-9462-491e-9b7f-69d860b22eca', None, None, None, None, None)] {{(pid=116021) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:23:34.403637 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-48518ef1-2edd-4723-9da6-d08947773616 req-100c4bdf-2080-48d8-beb8-be95dd64e92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02506a5c-6c61-442c-bedf-ffbe1dd23ff2", "name": "network-vif-plugged", "status": "completed", "tag": "08fcafa5-25ff-42a0-9063-587833cff4a1"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:34.407333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:34.407333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:23:34.428204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-48518ef1-2edd-4723-9da6-d08947773616 req-100c4bdf-2080-48d8-beb8-be95dd64e92b service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:34.429129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-48518ef1-2edd-4723-9da6-d08947773616 req-100c4bdf-2080-48d8-beb8-be95dd64e92b service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:34.447265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-48518ef1-2edd-4723-9da6-d08947773616 req-100c4bdf-2080-48d8-beb8-be95dd64e92b service nova] Creating event network-vif-plugged:08fcafa5-25ff-42a0-9063-587833cff4a1 for instance 02506a5c-6c61-442c-bedf-ffbe1dd23ff2 on hv-cinder-82002 Dec 15 16:23:34.454740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-48518ef1-2edd-4723-9da6-d08947773616 req-100c4bdf-2080-48d8-beb8-be95dd64e92b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073107 Dec 15 16:23:34.456339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 183/361] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:23:34.504985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f5b3d060-76ee-47d7-bcc5-73dcefbe4948 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:34.506672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f5b3d060-76ee-47d7-bcc5-73dcefbe4948 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:34.514391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f5b3d060-76ee-47d7-bcc5-73dcefbe4948 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:34.515432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f5b3d060-76ee-47d7-bcc5-73dcefbe4948 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:34.516632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f5b3d060-76ee-47d7-bcc5-73dcefbe4948 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:34.517259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f5b3d060-76ee-47d7-bcc5-73dcefbe4948 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:34.980314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f5b3d060-76ee-47d7-bcc5-73dcefbe4948 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:34.997521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f5b3d060-76ee-47d7-bcc5-73dcefbe4948 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 0.506732 Dec 15 16:23:35.009243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 184/362] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:34 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:35.014173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:35.015240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:35.028476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.028476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.030163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.030163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.281124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Flavor limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:23:35.283147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Image limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:23:35.284031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Flavor pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:23:35.286779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Image pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:23:35.287952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:23:35.300199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.301858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.303012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.303850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.326652 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:35.328169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Getting quotas for project 6f8f838e6a4647859457e5560571a5ab. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:35.335103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Getting quotas for user 191079f41ac04162bcb5382c3e872f3c and project 6f8f838e6a4647859457e5560571a5ab. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:35.339266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:35.341239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:35.342534 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b116d2b6-da20-4486-a9e1-199f94aab824 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1739 microversion: 2.20 time: 0.332333 Dec 15 16:23:35.343411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 185/363] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:35.365130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-91f16e0f-fb4b-4442-a534-80dd10749405 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:35.366214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-91f16e0f-fb4b-4442-a534-80dd10749405 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:35.374496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91f16e0f-fb4b-4442-a534-80dd10749405 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.374496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91f16e0f-fb4b-4442-a534-80dd10749405 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.374496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91f16e0f-fb4b-4442-a534-80dd10749405 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.374912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91f16e0f-fb4b-4442-a534-80dd10749405 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.415656 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Going to run 1 instances... {{(pid=116021) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:23:35.418014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='477ef1ba-dfe7-4605-81ba-610c9f58920d',volume_size=None,volume_type=None)] {{(pid=116021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:23:35.552969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-91f16e0f-fb4b-4442-a534-80dd10749405 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 37529 microversion: 2.1 time: 0.197205 Dec 15 16:23:35.555006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 186/364] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:35 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 37529 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:35.565541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ab4562dd-c776-40f7-9042-eec3c5e3fa26 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:35.567329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ab4562dd-c776-40f7-9042-eec3c5e3fa26 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:35.580561 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab4562dd-c776-40f7-9042-eec3c5e3fa26 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.581285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab4562dd-c776-40f7-9042-eec3c5e3fa26 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.582948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab4562dd-c776-40f7-9042-eec3c5e3fa26 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.583619 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab4562dd-c776-40f7-9042-eec3c5e3fa26 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.740747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4704087a-07b1-4267-8c30-c231394c9c71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.747434 Dec 15 16:23:35.755532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 179/365] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:23:33 2021] POST /compute/v2.1/servers => generated 405 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:23:35.790788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-00f7564c-10f0-44bc-a9b2-1f758267fb5f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:35.790788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-00f7564c-10f0-44bc-a9b2-1f758267fb5f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:35.803307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00f7564c-10f0-44bc-a9b2-1f758267fb5f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.803858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00f7564c-10f0-44bc-a9b2-1f758267fb5f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.805275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00f7564c-10f0-44bc-a9b2-1f758267fb5f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.806006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00f7564c-10f0-44bc-a9b2-1f758267fb5f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.945377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ab4562dd-c776-40f7-9042-eec3c5e3fa26 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:35.964190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ab4562dd-c776-40f7-9042-eec3c5e3fa26 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1317 microversion: 2.1 time: 0.406413 Dec 15 16:23:35.973502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 187/366] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:35 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:35.991065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e90f8a00-b94c-4020-b99a-0087e9ca31c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:35.993728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e90f8a00-b94c-4020-b99a-0087e9ca31c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:36.092358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00f7564c-10f0-44bc-a9b2-1f758267fb5f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:36.107911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-00f7564c-10f0-44bc-a9b2-1f758267fb5f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.364194 Dec 15 16:23:36.108544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 180/367] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:35 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:36.113753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a0729e6d-fb53-427f-bdab-dc186033ba41 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:36.135600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a0729e6d-fb53-427f-bdab-dc186033ba41 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:36.142372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0729e6d-fb53-427f-bdab-dc186033ba41 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:36.142844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0729e6d-fb53-427f-bdab-dc186033ba41 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:36.143955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0729e6d-fb53-427f-bdab-dc186033ba41 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:36.150364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0729e6d-fb53-427f-bdab-dc186033ba41 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:36.153415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e90f8a00-b94c-4020-b99a-0087e9ca31c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:36.163069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e90f8a00-b94c-4020-b99a-0087e9ca31c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1087 microversion: 2.1 time: 0.187346 Dec 15 16:23:36.163677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 188/368] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1087 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:36.371054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:36.372194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:36.406622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:36.408502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:36.410892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:36.425951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:36.620532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a0729e6d-fb53-427f-bdab-dc186033ba41 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:36.643568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a0729e6d-fb53-427f-bdab-dc186033ba41 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 0.531535 Dec 15 16:23:36.646537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 181/369] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:36 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:36.674888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1fda1b56-5fc7-479c-9531-44ab5f52b413 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:36.678473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1fda1b56-5fc7-479c-9531-44ab5f52b413 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:36.708768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1fda1b56-5fc7-479c-9531-44ab5f52b413 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:36.713602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1fda1b56-5fc7-479c-9531-44ab5f52b413 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:36.716556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1fda1b56-5fc7-479c-9531-44ab5f52b413 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:36.723182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1fda1b56-5fc7-479c-9531-44ab5f52b413 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:36.727589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:36.766658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:36.769854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:36.776627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ab084844-0098-42f6-95d2-fff3fc31bb8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1739 microversion: 2.20 time: 0.410752 Dec 15 16:23:36.786163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 189/370] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:36.890871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1fda1b56-5fc7-479c-9531-44ab5f52b413 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 38154 microversion: 2.1 time: 0.227371 Dec 15 16:23:36.896504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 182/371] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:36 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 38154 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:36.999104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-92b1e102-81a7-472d-b786-1c6f0caa9c1f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:37.000112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-92b1e102-81a7-472d-b786-1c6f0caa9c1f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:37.009755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b1e102-81a7-472d-b786-1c6f0caa9c1f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.010476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b1e102-81a7-472d-b786-1c6f0caa9c1f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.011582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b1e102-81a7-472d-b786-1c6f0caa9c1f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.012071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b1e102-81a7-472d-b786-1c6f0caa9c1f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.139459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b21b3b75-df38-4243-a2c2-95de2ecf3c7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:37.140420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b21b3b75-df38-4243-a2c2-95de2ecf3c7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:37.166051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21b3b75-df38-4243-a2c2-95de2ecf3c7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.177394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21b3b75-df38-4243-a2c2-95de2ecf3c7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.182239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21b3b75-df38-4243-a2c2-95de2ecf3c7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.183104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21b3b75-df38-4243-a2c2-95de2ecf3c7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.205979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-92b1e102-81a7-472d-b786-1c6f0caa9c1f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:37.223807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-92b1e102-81a7-472d-b786-1c6f0caa9c1f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1505 microversion: 2.1 time: 0.229303 Dec 15 16:23:37.224761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 190/372] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:36 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:37.229090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4927b79c-032a-4d01-a919-965e44c13a9a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:37.230647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4927b79c-032a-4d01-a919-965e44c13a9a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:37.243935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4927b79c-032a-4d01-a919-965e44c13a9a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.247503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4927b79c-032a-4d01-a919-965e44c13a9a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.249259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4927b79c-032a-4d01-a919-965e44c13a9a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.249259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4927b79c-032a-4d01-a919-965e44c13a9a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.389865 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4927b79c-032a-4d01-a919-965e44c13a9a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:37.398413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4927b79c-032a-4d01-a919-965e44c13a9a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1185 microversion: 2.1 time: 0.172697 Dec 15 16:23:37.404671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 191/373] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:37 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:37.513742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b21b3b75-df38-4243-a2c2-95de2ecf3c7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:37.530263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b21b3b75-df38-4243-a2c2-95de2ecf3c7c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.397542 Dec 15 16:23:37.530775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 183/374] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:37 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:37.675979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c1f698b3-365a-49b5-8527-47aa9aa33398 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:37.676729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c1f698b3-365a-49b5-8527-47aa9aa33398 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:37.683312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1f698b3-365a-49b5-8527-47aa9aa33398 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.683755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1f698b3-365a-49b5-8527-47aa9aa33398 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.688419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1f698b3-365a-49b5-8527-47aa9aa33398 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.690177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1f698b3-365a-49b5-8527-47aa9aa33398 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.797992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:37.801321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:37.828967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.832108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.837831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.840697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.005922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c1f698b3-365a-49b5-8527-47aa9aa33398 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:38.034289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c1f698b3-365a-49b5-8527-47aa9aa33398 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 0.360880 Dec 15 16:23:38.046207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 192/375] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:37 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:38.067841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4309170f-fda7-465e-bfaa-43282fe99691 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:38.071225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4309170f-fda7-465e-bfaa-43282fe99691 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:38.081470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4309170f-fda7-465e-bfaa-43282fe99691 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.082631 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4309170f-fda7-465e-bfaa-43282fe99691 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.090885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4309170f-fda7-465e-bfaa-43282fe99691 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.093145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4309170f-fda7-465e-bfaa-43282fe99691 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.247766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4309170f-fda7-465e-bfaa-43282fe99691 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 38175 microversion: 2.1 time: 0.199273 Dec 15 16:23:38.252997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 193/376] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:38 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 38175 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:38.407607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:38.425409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-97dc8044-adf8-4994-835e-04d93e3c3cb0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:38.428380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-97dc8044-adf8-4994-835e-04d93e3c3cb0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:38.432598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:38.438709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:38.442748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-05ee3702-d69e-4480-83a6-60f5ba469c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1739 microversion: 2.20 time: 0.651893 Dec 15 16:23:38.463737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 184/377] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1739 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:38.472976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97dc8044-adf8-4994-835e-04d93e3c3cb0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.479616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97dc8044-adf8-4994-835e-04d93e3c3cb0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.481065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97dc8044-adf8-4994-835e-04d93e3c3cb0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.489967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97dc8044-adf8-4994-835e-04d93e3c3cb0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.548412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-33f4822e-4652-415a-a1b1-ed0cb12c6e38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:38.549075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-33f4822e-4652-415a-a1b1-ed0cb12c6e38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:38.560402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33f4822e-4652-415a-a1b1-ed0cb12c6e38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.560887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33f4822e-4652-415a-a1b1-ed0cb12c6e38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.561727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33f4822e-4652-415a-a1b1-ed0cb12c6e38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.562231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33f4822e-4652-415a-a1b1-ed0cb12c6e38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.604042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-97dc8044-adf8-4994-835e-04d93e3c3cb0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:38.619033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-97dc8044-adf8-4994-835e-04d93e3c3cb0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1203 microversion: 2.1 time: 0.200992 Dec 15 16:23:38.626697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 194/378] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1203 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:38.832794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-33f4822e-4652-415a-a1b1-ed0cb12c6e38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:38.855970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-33f4822e-4652-415a-a1b1-ed0cb12c6e38 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.308035 Dec 15 16:23:38.861203 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 185/379] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:38 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:39.063835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2273594d-625d-4a3d-901e-0044545e9a9a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:39.065990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2273594d-625d-4a3d-901e-0044545e9a9a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:39.086265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2273594d-625d-4a3d-901e-0044545e9a9a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.088153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2273594d-625d-4a3d-901e-0044545e9a9a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.090467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2273594d-625d-4a3d-901e-0044545e9a9a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.091610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2273594d-625d-4a3d-901e-0044545e9a9a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.265715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1dff91c6-92a0-4de1-a0ed-8c046c973d68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:39.266768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1dff91c6-92a0-4de1-a0ed-8c046c973d68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:39.289493 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1dff91c6-92a0-4de1-a0ed-8c046c973d68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.291180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1dff91c6-92a0-4de1-a0ed-8c046c973d68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.295070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1dff91c6-92a0-4de1-a0ed-8c046c973d68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.295951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1dff91c6-92a0-4de1-a0ed-8c046c973d68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.418587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2273594d-625d-4a3d-901e-0044545e9a9a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:39.424470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1dff91c6-92a0-4de1-a0ed-8c046c973d68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 38306 microversion: 2.1 time: 0.167057 Dec 15 16:23:39.426507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 186/380] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:39 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 38306 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:39.427199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2273594d-625d-4a3d-901e-0044545e9a9a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 0.366894 Dec 15 16:23:39.437198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 195/381] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:39 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:39.445765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-72cc99e2-cf7b-4b5e-834f-947ceed2f5bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:39.446750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-72cc99e2-cf7b-4b5e-834f-947ceed2f5bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:39.460209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72cc99e2-cf7b-4b5e-834f-947ceed2f5bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.461328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72cc99e2-cf7b-4b5e-834f-947ceed2f5bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.462725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72cc99e2-cf7b-4b5e-834f-947ceed2f5bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.463701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72cc99e2-cf7b-4b5e-834f-947ceed2f5bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.474693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:39.475497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:39.486673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.487295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.488333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.488952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.526902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-72cc99e2-cf7b-4b5e-834f-947ceed2f5bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/ips" status: 200 len: 146 microversion: 2.1 time: 0.089056 Dec 15 16:23:39.541738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 187/382] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Dec 15 16:23:39 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/ips => generated 146 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:39.647002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5b92384d-df84-40e8-b243-12016b37413a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:39.648667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5b92384d-df84-40e8-b243-12016b37413a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:39.660746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b92384d-df84-40e8-b243-12016b37413a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.661545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b92384d-df84-40e8-b243-12016b37413a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.663344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b92384d-df84-40e8-b243-12016b37413a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.664360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b92384d-df84-40e8-b243-12016b37413a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:40.025004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:40.044474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:40.046153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:40.047403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bc9d7f9f-6846-4b53-b8e6-1c057571cccf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1739 microversion: 2.20 time: 0.576784 Dec 15 16:23:40.059578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 196/383] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:40.074206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-06cc1534-f5af-4d06-861d-09ae70a46374 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:40.075628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-06cc1534-f5af-4d06-861d-09ae70a46374 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:40.089350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06cc1534-f5af-4d06-861d-09ae70a46374 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:40.090147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06cc1534-f5af-4d06-861d-09ae70a46374 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:40.094819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06cc1534-f5af-4d06-861d-09ae70a46374 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:40.095802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06cc1534-f5af-4d06-861d-09ae70a46374 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:40.171004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5b92384d-df84-40e8-b243-12016b37413a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:40.264152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5b92384d-df84-40e8-b243-12016b37413a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.624141 Dec 15 16:23:40.276377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 188/384] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:40.446481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c14d1c97-e909-4735-af4d-4b8024f7709e tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:40.447174 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c14d1c97-e909-4735-af4d-4b8024f7709e tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:40.454308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c14d1c97-e909-4735-af4d-4b8024f7709e tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:40.454690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c14d1c97-e909-4735-af4d-4b8024f7709e tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:40.455519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c14d1c97-e909-4735-af4d-4b8024f7709e tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:40.456021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c14d1c97-e909-4735-af4d-4b8024f7709e tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.372368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c14d1c97-e909-4735-af4d-4b8024f7709e tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:41.389363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-06cc1534-f5af-4d06-861d-09ae70a46374 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:41.396613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c14d1c97-e909-4735-af4d-4b8024f7709e tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 0.955748 Dec 15 16:23:41.410045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-06cc1534-f5af-4d06-861d-09ae70a46374 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 1.343769 Dec 15 16:23:41.410885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 197/386] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:40 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:41.420933 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 189/386] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:40 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:41.423084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-8d836a97-e351-4a25-b47d-e00ed95ca095 req-e081efba-9759-440b-a547-7a26c486986d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137d6291-391b-4c93-8ed1-dd2dcb656e91", "name": "network-vif-plugged", "status": "completed", "tag": "e8280a72-286e-4a04-81c8-a6c7e1391550"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:41.426082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:41.426082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:23:41.427518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:41.428619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:41.439831 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-8d836a97-e351-4a25-b47d-e00ed95ca095 req-e081efba-9759-440b-a547-7a26c486986d service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.440632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-8d836a97-e351-4a25-b47d-e00ed95ca095 req-e081efba-9759-440b-a547-7a26c486986d service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.440830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.441574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.442420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.442856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.471041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-8d836a97-e351-4a25-b47d-e00ed95ca095 req-e081efba-9759-440b-a547-7a26c486986d service nova] Creating event network-vif-plugged:e8280a72-286e-4a04-81c8-a6c7e1391550 for instance 137d6291-391b-4c93-8ed1-dd2dcb656e91 on hv-cinder-82002 Dec 15 16:23:41.481521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-8d836a97-e351-4a25-b47d-e00ed95ca095 req-e081efba-9759-440b-a547-7a26c486986d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069173 Dec 15 16:23:41.484505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 198/387] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:41.495234 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-23256ae3-5e08-45dc-81ea-409adad840de tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:41.496641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-23256ae3-5e08-45dc-81ea-409adad840de tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:41.505617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23256ae3-5e08-45dc-81ea-409adad840de tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.506261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23256ae3-5e08-45dc-81ea-409adad840de tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.507245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23256ae3-5e08-45dc-81ea-409adad840de tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.507689 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23256ae3-5e08-45dc-81ea-409adad840de tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.787703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:41.798049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:41.800122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:41.801855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ca15507d-7400-443e-a3fe-65dcb40b85dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1739 microversion: 2.20 time: 0.379498 Dec 15 16:23:41.803061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 190/388] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1739 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:41.832424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-23256ae3-5e08-45dc-81ea-409adad840de tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:41.838596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-23256ae3-5e08-45dc-81ea-409adad840de tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.352916 Dec 15 16:23:41.839279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 199/389] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:41 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:41.955609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-1e584df4-ef38-41a0-9a53-2075e523972e req-2ce59ee8-ba07-4830-a8f0-ea17c367aebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4fd848-09ba-42aa-9176-dc8a60b95be2", "tag": "2c61efe0-6ed5-4b49-8a66-8e9f491633d4"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:41.958795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:41.958795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:23:41.973009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-1e584df4-ef38-41a0-9a53-2075e523972e req-2ce59ee8-ba07-4830-a8f0-ea17c367aebf service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.981286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-1e584df4-ef38-41a0-9a53-2075e523972e req-2ce59ee8-ba07-4830-a8f0-ea17c367aebf service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:42.005608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-1e584df4-ef38-41a0-9a53-2075e523972e req-2ce59ee8-ba07-4830-a8f0-ea17c367aebf service nova] Creating event network-changed:2c61efe0-6ed5-4b49-8a66-8e9f491633d4 for instance 4c4fd848-09ba-42aa-9176-dc8a60b95be2 on hv-cinder-82002 Dec 15 16:23:42.013318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-1e584df4-ef38-41a0-9a53-2075e523972e req-2ce59ee8-ba07-4830-a8f0-ea17c367aebf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061047 Dec 15 16:23:42.014341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 191/390] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:42.390777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7ad342c9-2983-482b-81aa-7fd7085b1e23 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ddcbbd6-77a3-40fe-ba9f-2424d44f9bd6"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:42.392396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7ad342c9-2983-482b-81aa-7fd7085b1e23 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:42.406231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ad342c9-2983-482b-81aa-7fd7085b1e23 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.406777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ad342c9-2983-482b-81aa-7fd7085b1e23 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:42.409685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ad342c9-2983-482b-81aa-7fd7085b1e23 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.409685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ad342c9-2983-482b-81aa-7fd7085b1e23 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:42.425909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-853d5ab7-f49f-4eb3-9c0e-e0482f0d5520 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:42.425909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-853d5ab7-f49f-4eb3-9c0e-e0482f0d5520 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:42.433247 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-853d5ab7-f49f-4eb3-9c0e-e0482f0d5520 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.434220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-853d5ab7-f49f-4eb3-9c0e-e0482f0d5520 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:42.435745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-853d5ab7-f49f-4eb3-9c0e-e0482f0d5520 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.436681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-853d5ab7-f49f-4eb3-9c0e-e0482f0d5520 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:42.738888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-853d5ab7-f49f-4eb3-9c0e-e0482f0d5520 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:42.768112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-853d5ab7-f49f-4eb3-9c0e-e0482f0d5520 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 0.355815 Dec 15 16:23:42.769222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 192/391] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:42 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:42.777859 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e43fa151-e420-4aec-ac22-40480b0b2851 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:42.778926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e43fa151-e420-4aec-ac22-40480b0b2851 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:42.791466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e43fa151-e420-4aec-ac22-40480b0b2851 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.792766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e43fa151-e420-4aec-ac22-40480b0b2851 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:42.794215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e43fa151-e420-4aec-ac22-40480b0b2851 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.795219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e43fa151-e420-4aec-ac22-40480b0b2851 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.048710 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7ad342c9-2983-482b-81aa-7fd7085b1e23 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.661466 Dec 15 16:23:43.054375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 200/392] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Dec 15 16:23:42 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 194 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:43.057202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:43.058015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:43.066708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.067479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.069188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.069748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.302288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e43fa151-e420-4aec-ac22-40480b0b2851 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:43.312888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e43fa151-e420-4aec-ac22-40480b0b2851 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.541862 Dec 15 16:23:43.313933 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 193/393] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:42 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:43.319489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-932b1a09-8997-4253-9796-09b9d1667bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:43.320195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-932b1a09-8997-4253-9796-09b9d1667bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:43.326584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-932b1a09-8997-4253-9796-09b9d1667bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.327129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-932b1a09-8997-4253-9796-09b9d1667bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.328016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-932b1a09-8997-4253-9796-09b9d1667bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.328552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-932b1a09-8997-4253-9796-09b9d1667bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.481866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:43.496554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:43.498152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:43.499391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-76d4fbea-6df7-4090-9087-ef9090edb13b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1721 microversion: 2.20 time: 0.447631 Dec 15 16:23:43.499964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 201/394] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1721 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:43.675802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-932b1a09-8997-4253-9796-09b9d1667bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:43.689763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-932b1a09-8997-4253-9796-09b9d1667bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.373985 Dec 15 16:23:43.690740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 194/395] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:43 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:43.786566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-42e5c1a7-4eec-40de-bf52-99df1cc0f045 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:43.787448 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-42e5c1a7-4eec-40de-bf52-99df1cc0f045 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:43.795087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e5c1a7-4eec-40de-bf52-99df1cc0f045 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.795566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e5c1a7-4eec-40de-bf52-99df1cc0f045 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.796381 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e5c1a7-4eec-40de-bf52-99df1cc0f045 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.796844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e5c1a7-4eec-40de-bf52-99df1cc0f045 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.996813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-42e5c1a7-4eec-40de-bf52-99df1cc0f045 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:44.006949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-42e5c1a7-4eec-40de-bf52-99df1cc0f045 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1312 microversion: 2.1 time: 0.224268 Dec 15 16:23:44.007730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 202/396] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:43 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:44.330110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4b8acf26-abe2-406f-a5de-18bde1022840 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:44.330711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4b8acf26-abe2-406f-a5de-18bde1022840 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:44.337720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b8acf26-abe2-406f-a5de-18bde1022840 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.338280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b8acf26-abe2-406f-a5de-18bde1022840 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.339404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b8acf26-abe2-406f-a5de-18bde1022840 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.339920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b8acf26-abe2-406f-a5de-18bde1022840 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.497147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4b8acf26-abe2-406f-a5de-18bde1022840 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:44.512304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4b8acf26-abe2-406f-a5de-18bde1022840 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.184974 Dec 15 16:23:44.513107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 195/397] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:44 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:44.527906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:44.528757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:44.536120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.536635 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.537590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.538069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.686488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:44.700859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:44.703945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:44.706143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1b302445-cba8-469d-b532-331e46338c1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1721 microversion: 2.20 time: 0.181805 Dec 15 16:23:44.708067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2343278b-522f-4c05-9a31-0ae3edeabd82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:44.708701 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 203/398] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:44.708850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2343278b-522f-4c05-9a31-0ae3edeabd82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:44.715121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2343278b-522f-4c05-9a31-0ae3edeabd82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.715567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2343278b-522f-4c05-9a31-0ae3edeabd82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.716364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2343278b-522f-4c05-9a31-0ae3edeabd82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.716869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2343278b-522f-4c05-9a31-0ae3edeabd82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.882171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2343278b-522f-4c05-9a31-0ae3edeabd82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:44.889953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2343278b-522f-4c05-9a31-0ae3edeabd82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.186341 Dec 15 16:23:44.890540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 196/399] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:45.027327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e3c4a33c-05ad-4c30-9e05-8d8ed79e1739 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.027836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e3c4a33c-05ad-4c30-9e05-8d8ed79e1739 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.034853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3c4a33c-05ad-4c30-9e05-8d8ed79e1739 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.035916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3c4a33c-05ad-4c30-9e05-8d8ed79e1739 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.036787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3c4a33c-05ad-4c30-9e05-8d8ed79e1739 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.037233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3c4a33c-05ad-4c30-9e05-8d8ed79e1739 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.188337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e3c4a33c-05ad-4c30-9e05-8d8ed79e1739 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:45.196989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e3c4a33c-05ad-4c30-9e05-8d8ed79e1739 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1495 microversion: 2.1 time: 0.173356 Dec 15 16:23:45.197585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 204/400] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:45 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1495 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:45.531186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-94ec2a19-975e-4dd9-9df9-145a075ee1b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.531879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-94ec2a19-975e-4dd9-9df9-145a075ee1b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.538821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94ec2a19-975e-4dd9-9df9-145a075ee1b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.539302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94ec2a19-975e-4dd9-9df9-145a075ee1b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.540124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94ec2a19-975e-4dd9-9df9-145a075ee1b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.540572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94ec2a19-975e-4dd9-9df9-145a075ee1b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.729622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.730576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.731911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-94ec2a19-975e-4dd9-9df9-145a075ee1b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:45.741069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.741781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.743389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.744085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.747215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-94ec2a19-975e-4dd9-9df9-145a075ee1b4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.219540 Dec 15 16:23:45.748877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 197/401] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:45 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:45.836859 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-df1fa542-f486-49d4-94f3-7582d3d4e5f9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.837425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-df1fa542-f486-49d4-94f3-7582d3d4e5f9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.844059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df1fa542-f486-49d4-94f3-7582d3d4e5f9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.844595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df1fa542-f486-49d4-94f3-7582d3d4e5f9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.845755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df1fa542-f486-49d4-94f3-7582d3d4e5f9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.846504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df1fa542-f486-49d4-94f3-7582d3d4e5f9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.877558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-df1fa542-f486-49d4-94f3-7582d3d4e5f9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:23:45.914799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:45.926062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:45.927712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:45.929222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2ef88e7e-ccc1-46ea-9998-9b8ed2713eac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1721 microversion: 2.20 time: 0.205220 Dec 15 16:23:45.930149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 205/402] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:45.934941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-edafe0f1-3291-46b7-9024-396a4d68af55 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.935879 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-edafe0f1-3291-46b7-9024-396a4d68af55 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.943567 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edafe0f1-3291-46b7-9024-396a4d68af55 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.944035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edafe0f1-3291-46b7-9024-396a4d68af55 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.945956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edafe0f1-3291-46b7-9024-396a4d68af55 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.946420 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edafe0f1-3291-46b7-9024-396a4d68af55 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.966882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-df1fa542-f486-49d4-94f3-7582d3d4e5f9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "DELETE /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 204 len: 0 microversion: 2.1 time: 0.134969 Dec 15 16:23:45.967571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 198/403] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:23:45 2021] DELETE /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:23:45.977037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-07e465a0-a249-489d-9f34-f8676832c8b4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.977631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-07e465a0-a249-489d-9f34-f8676832c8b4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.984676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07e465a0-a249-489d-9f34-f8676832c8b4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.985106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07e465a0-a249-489d-9f34-f8676832c8b4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.985935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07e465a0-a249-489d-9f34-f8676832c8b4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.986396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07e465a0-a249-489d-9f34-f8676832c8b4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.171977 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-edafe0f1-3291-46b7-9024-396a4d68af55 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:46.179976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-07e465a0-a249-489d-9f34-f8676832c8b4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:46.180194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-edafe0f1-3291-46b7-9024-396a4d68af55 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.249144 Dec 15 16:23:46.180771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 206/404] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:46.187944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-07e465a0-a249-489d-9f34-f8676832c8b4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1501 microversion: 2.1 time: 0.215499 Dec 15 16:23:46.188536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 199/405] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:45 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1501 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:46.402529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-2497994b-9798-42ce-a12b-8200150b44b5 req-f912e879-4f11-4141-8056-31749d76898e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134cc886-afce-4a89-b875-cdf6768bfd8f", "name": "network-vif-unplugged", "status": "completed", "tag": "9b8f6012-13ef-4292-8d62-47854410ace5"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:46.406385 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:46.406385 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:23:46.418383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-2497994b-9798-42ce-a12b-8200150b44b5 req-f912e879-4f11-4141-8056-31749d76898e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.419291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-2497994b-9798-42ce-a12b-8200150b44b5 req-f912e879-4f11-4141-8056-31749d76898e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.433854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-2497994b-9798-42ce-a12b-8200150b44b5 req-f912e879-4f11-4141-8056-31749d76898e service nova] Creating event network-vif-unplugged:9b8f6012-13ef-4292-8d62-47854410ace5 for instance 134cc886-afce-4a89-b875-cdf6768bfd8f on hv-cinder-82002 Dec 15 16:23:46.440137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-2497994b-9798-42ce-a12b-8200150b44b5 req-f912e879-4f11-4141-8056-31749d76898e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043042 Dec 15 16:23:46.440994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 207/406] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:46.768512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-913b8b6c-f6b1-4c66-b2a8-a840b158a001 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:46.769526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-913b8b6c-f6b1-4c66-b2a8-a840b158a001 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:46.782195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-913b8b6c-f6b1-4c66-b2a8-a840b158a001 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.782958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-913b8b6c-f6b1-4c66-b2a8-a840b158a001 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.783795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-913b8b6c-f6b1-4c66-b2a8-a840b158a001 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.784228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-913b8b6c-f6b1-4c66-b2a8-a840b158a001 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.947052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-913b8b6c-f6b1-4c66-b2a8-a840b158a001 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:46.956338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-913b8b6c-f6b1-4c66-b2a8-a840b158a001 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.192414 Dec 15 16:23:46.957767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 200/407] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:46 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:46.962853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:46.963753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:46.971085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.971525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.972329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.972797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.157260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:47.166645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:47.168786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:47.170842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-33ae85aa-c221-4968-9c1d-d2dac6f5e96c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1664 microversion: 2.20 time: 0.213722 Dec 15 16:23:47.173502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 208/408] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1664 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:47.191373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-911889e0-93a0-4113-a566-e2783d4f2dbb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4276f5f-7069-4ad3-8bbd-063936d4d3b5"}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:47.192760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-911889e0-93a0-4113-a566-e2783d4f2dbb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:47.201439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f71d809f-1ab3-4ce2-8800-665d27b92602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:47.202470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-911889e0-93a0-4113-a566-e2783d4f2dbb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.202607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f71d809f-1ab3-4ce2-8800-665d27b92602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:47.203428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-911889e0-93a0-4113-a566-e2783d4f2dbb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.205140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-911889e0-93a0-4113-a566-e2783d4f2dbb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.205923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-911889e0-93a0-4113-a566-e2783d4f2dbb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.213339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f71d809f-1ab3-4ce2-8800-665d27b92602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.214133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f71d809f-1ab3-4ce2-8800-665d27b92602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.215577 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f71d809f-1ab3-4ce2-8800-665d27b92602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.216353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f71d809f-1ab3-4ce2-8800-665d27b92602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.401411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f71d809f-1ab3-4ce2-8800-665d27b92602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:47.414818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f71d809f-1ab3-4ce2-8800-665d27b92602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.219623 Dec 15 16:23:47.417714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 209/409] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:47.435665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ebab1765-ef77-49af-a956-6ab6eaee378d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:47.436300 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ebab1765-ef77-49af-a956-6ab6eaee378d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:47.447832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ebab1765-ef77-49af-a956-6ab6eaee378d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.448668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ebab1765-ef77-49af-a956-6ab6eaee378d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.449585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ebab1765-ef77-49af-a956-6ab6eaee378d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.450026 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ebab1765-ef77-49af-a956-6ab6eaee378d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.576910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-911889e0-93a0-4113-a566-e2783d4f2dbb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.389826 Dec 15 16:23:47.578101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 201/410] 10.222.0.30 () {62 vars in 1363 bytes} [Wed Dec 15 16:23:47 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 188 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:23:47.608677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ebab1765-ef77-49af-a956-6ab6eaee378d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:47.618424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ebab1765-ef77-49af-a956-6ab6eaee378d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1501 microversion: 2.1 time: 0.199029 Dec 15 16:23:47.619017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 210/411] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:47 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:47.719393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f720ce10-0e4d-421e-9623-de0009dfb15a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:47.720251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f720ce10-0e4d-421e-9623-de0009dfb15a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:47.731517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f720ce10-0e4d-421e-9623-de0009dfb15a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.732304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f720ce10-0e4d-421e-9623-de0009dfb15a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.734165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f720ce10-0e4d-421e-9623-de0009dfb15a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.734929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f720ce10-0e4d-421e-9623-de0009dfb15a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.844837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f720ce10-0e4d-421e-9623-de0009dfb15a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 202 len: 0 microversion: 2.20 time: 0.131261 Dec 15 16:23:47.848148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 202/412] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:23:47 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:23:47.856913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:47.858414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:47.879348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.880591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.882209 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.882853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.979562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-61ce1e49-452e-4648-8c6e-2044e17b9422 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:47.980652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-61ce1e49-452e-4648-8c6e-2044e17b9422 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:47.991181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61ce1e49-452e-4648-8c6e-2044e17b9422 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.991745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61ce1e49-452e-4648-8c6e-2044e17b9422 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.992650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61ce1e49-452e-4648-8c6e-2044e17b9422 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.993154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61ce1e49-452e-4648-8c6e-2044e17b9422 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.092640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:48.103412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:48.104952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:48.106151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-51529674-0ee1-49a6-9d71-dadace39e617 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1750 microversion: 2.20 time: 0.256429 Dec 15 16:23:48.106725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 211/413] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1750 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:48.175598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-61ce1e49-452e-4648-8c6e-2044e17b9422 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:48.188765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-61ce1e49-452e-4648-8c6e-2044e17b9422 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.216543 Dec 15 16:23:48.189798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 203/414] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:47 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:48.450624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b7930ca9-0342-4fb3-89ed-30641b8b4f71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:48.453457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b7930ca9-0342-4fb3-89ed-30641b8b4f71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:48.466197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7930ca9-0342-4fb3-89ed-30641b8b4f71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.466995 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7930ca9-0342-4fb3-89ed-30641b8b4f71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.469261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7930ca9-0342-4fb3-89ed-30641b8b4f71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.469941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7930ca9-0342-4fb3-89ed-30641b8b4f71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.642843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9bdcff72-1a18-4868-9f53-a036650e124d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:48.644216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9bdcff72-1a18-4868-9f53-a036650e124d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:48.654292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9bdcff72-1a18-4868-9f53-a036650e124d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.654738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9bdcff72-1a18-4868-9f53-a036650e124d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.655839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9bdcff72-1a18-4868-9f53-a036650e124d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.656323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9bdcff72-1a18-4868-9f53-a036650e124d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.793142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b7930ca9-0342-4fb3-89ed-30641b8b4f71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:48.803336 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b7930ca9-0342-4fb3-89ed-30641b8b4f71 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.359311 Dec 15 16:23:48.806711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 212/415] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:48.991972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9bdcff72-1a18-4868-9f53-a036650e124d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:49.007485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9bdcff72-1a18-4868-9f53-a036650e124d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1501 microversion: 2.1 time: 0.371257 Dec 15 16:23:49.008600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 204/416] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:48 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1501 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:49.125305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:49.126722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:49.137937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.138372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.140920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.142241 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.221224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-317b6c65-63e5-4ca9-81b0-130f96a42715 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:49.224761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-317b6c65-63e5-4ca9-81b0-130f96a42715 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:49.239014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-317b6c65-63e5-4ca9-81b0-130f96a42715 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.241444 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-317b6c65-63e5-4ca9-81b0-130f96a42715 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.243264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-317b6c65-63e5-4ca9-81b0-130f96a42715 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.244092 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-317b6c65-63e5-4ca9-81b0-130f96a42715 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.344990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:49.359393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:49.361406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:49.363094 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f3475cfb-5d57-45ab-a023-701e6633a8b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1750 microversion: 2.20 time: 0.241611 Dec 15 16:23:49.363820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 213/417] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1750 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:49.382694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-65519718-6087-46ee-ba5d-1258017dbd83 req-be682ca9-fd10-4c2a-a4a5-e7d9275f980d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137d6291-391b-4c93-8ed1-dd2dcb656e91", "name": "network-vif-deleted", "tag": "e8280a72-286e-4a04-81c8-a6c7e1391550"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:49.384663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:49.384663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:23:49.395187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-65519718-6087-46ee-ba5d-1258017dbd83 req-be682ca9-fd10-4c2a-a4a5-e7d9275f980d service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.395640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-65519718-6087-46ee-ba5d-1258017dbd83 req-be682ca9-fd10-4c2a-a4a5-e7d9275f980d service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.420166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-65519718-6087-46ee-ba5d-1258017dbd83 req-be682ca9-fd10-4c2a-a4a5-e7d9275f980d service nova] Creating event network-vif-deleted:e8280a72-286e-4a04-81c8-a6c7e1391550 for instance 137d6291-391b-4c93-8ed1-dd2dcb656e91 on hv-cinder-82002 Dec 15 16:23:49.431734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-65519718-6087-46ee-ba5d-1258017dbd83 req-be682ca9-fd10-4c2a-a4a5-e7d9275f980d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065873 Dec 15 16:23:49.439514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 214/418] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:49.487847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-317b6c65-63e5-4ca9-81b0-130f96a42715 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:49.502293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-317b6c65-63e5-4ca9-81b0-130f96a42715 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.290010 Dec 15 16:23:49.504557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 205/419] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:49 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:49.821256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-80b15c75-17f4-4f23-ae3f-40650a79fd35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:49.821962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-80b15c75-17f4-4f23-ae3f-40650a79fd35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:49.829123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80b15c75-17f4-4f23-ae3f-40650a79fd35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.829567 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80b15c75-17f4-4f23-ae3f-40650a79fd35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.830377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80b15c75-17f4-4f23-ae3f-40650a79fd35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.830805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80b15c75-17f4-4f23-ae3f-40650a79fd35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.996404 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80b15c75-17f4-4f23-ae3f-40650a79fd35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.005530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-80b15c75-17f4-4f23-ae3f-40650a79fd35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.188647 Dec 15 16:23:50.006138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 215/420] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:49 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:50.027202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:50.028889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:50.039733 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.040260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.041200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.041832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.078884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.079238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.079699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lazy-loading 'fault' on Instance uuid 137d6291-391b-4c93-8ed1-dd2dcb656e91 {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:23:50.125225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.133802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b21349d3-4756-4249-b2aa-f51f66ea32ce tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 200 len: 1302 microversion: 2.1 time: 0.111214 Dec 15 16:23:50.134379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 206/421] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:50 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:50.383066 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:50.383882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:50.391060 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.391690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.392758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.393198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.521039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-26efc0fb-41b9-4f4a-90e0-7190fb5487b8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:50.521771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-26efc0fb-41b9-4f4a-90e0-7190fb5487b8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:50.530602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26efc0fb-41b9-4f4a-90e0-7190fb5487b8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.531441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26efc0fb-41b9-4f4a-90e0-7190fb5487b8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.532561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26efc0fb-41b9-4f4a-90e0-7190fb5487b8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.533217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26efc0fb-41b9-4f4a-90e0-7190fb5487b8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.547523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.559615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.561485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.562991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-de51ef37-f907-41c9-a9a3-cc5be70b7477 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1752 microversion: 2.20 time: 0.183802 Dec 15 16:23:50.563649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 216/422] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:50.687723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-26efc0fb-41b9-4f4a-90e0-7190fb5487b8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.697674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-26efc0fb-41b9-4f4a-90e0-7190fb5487b8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1568 microversion: 2.1 time: 0.180574 Dec 15 16:23:50.698345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 207/423] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:50 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:51.028379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d2979abd-f813-4dbf-af8e-2a4982fc0b94 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:51.028937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d2979abd-f813-4dbf-af8e-2a4982fc0b94 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:51.035268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d2979abd-f813-4dbf-af8e-2a4982fc0b94 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.035714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d2979abd-f813-4dbf-af8e-2a4982fc0b94 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.036537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d2979abd-f813-4dbf-af8e-2a4982fc0b94 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.036976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d2979abd-f813-4dbf-af8e-2a4982fc0b94 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.156385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-99e70b1d-a408-43f9-9956-44bb0ade0fe8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:51.157787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-99e70b1d-a408-43f9-9956-44bb0ade0fe8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: 137d6291-391b-4c93-8ed1-dd2dcb656e91] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:51.166155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99e70b1d-a408-43f9-9956-44bb0ade0fe8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.166600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99e70b1d-a408-43f9-9956-44bb0ade0fe8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.167380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99e70b1d-a408-43f9-9956-44bb0ade0fe8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.167813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99e70b1d-a408-43f9-9956-44bb0ade0fe8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.184655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-99e70b1d-a408-43f9-9956-44bb0ade0fe8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] HTTP exception thrown: Instance 137d6291-391b-4c93-8ed1-dd2dcb656e91 could not be found. Dec 15 16:23:51.185292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-99e70b1d-a408-43f9-9956-44bb0ade0fe8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Returning 404 to user: Instance 137d6291-391b-4c93-8ed1-dd2dcb656e91 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:23:51.186132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-99e70b1d-a408-43f9-9956-44bb0ade0fe8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91" status: 404 len: 111 microversion: 2.1 time: 0.034283 Dec 15 16:23:51.188321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d2979abd-f813-4dbf-af8e-2a4982fc0b94 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:51.190269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 208/424] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:51 2021] GET /compute/v2.1/servers/137d6291-391b-4c93-8ed1-dd2dcb656e91 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:23:51.198281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d2979abd-f813-4dbf-af8e-2a4982fc0b94 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.173608 Dec 15 16:23:51.199244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 217/425] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:51.293146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1014037445", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "networks": [{"uuid": "5688c779-4ca9-4a8a-9f7d-0ebc8aa55b8c"}]}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:51.355620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.network.neutron [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] validate_networks() for [('5688c779-4ca9-4a8a-9f7d-0ebc8aa55b8c', None, None, None, None, None)] {{(pid=116021) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:23:51.590718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:51.591363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:51.598455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.598901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.599835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.600328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.871794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Flavor limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:23:51.872199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Image limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:23:51.872737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Flavor pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:23:51.873137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Image pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:23:51.873574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:23:51.886566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.887556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.889051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.889835 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.911699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:51.922601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Getting quotas for project c2df09e649444bf3bb3bc80331201c25. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:51.925766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:51.927662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:51.928911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-61d33461-1164-4d3b-978d-513137a3468c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1752 microversion: 2.20 time: 0.342053 Dec 15 16:23:51.929487 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 218/426] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1752 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:51.930614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Getting quotas for user ce7baeebd2974de2842369ccd0a588cb and project c2df09e649444bf3bb3bc80331201c25. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:51.934449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d918f4a2-8990-4505-a9cc-8229d71d6098 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:51.935301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d918f4a2-8990-4505-a9cc-8229d71d6098 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:51.942335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d918f4a2-8990-4505-a9cc-8229d71d6098 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.943131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d918f4a2-8990-4505-a9cc-8229d71d6098 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.943956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d918f4a2-8990-4505-a9cc-8229d71d6098 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.944388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d918f4a2-8990-4505-a9cc-8229d71d6098 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.955951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Going to run 1 instances... {{(pid=116021) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:23:51.959233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:23:52.013073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-32ab5a24-d6c5-484c-ad20-c35379485c5b tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725373 Dec 15 16:23:52.019734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 209/427] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:23:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:23:52.025837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-439ab81e-0a17-4d8f-99af-c814d4b1dfca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:52.037533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-439ab81e-0a17-4d8f-99af-c814d4b1dfca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.038201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-439ab81e-0a17-4d8f-99af-c814d4b1dfca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.103715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-439ab81e-0a17-4d8f-99af-c814d4b1dfca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Going to try to stop instance {{(pid=116021) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 16:23:52.172686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-439ab81e-0a17-4d8f-99af-c814d4b1dfca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 202 len: 0 microversion: 2.1 time: 0.149771 Dec 15 16:23:52.173397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 210/428] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:52 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:23:52.185536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d918f4a2-8990-4505-a9cc-8229d71d6098 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:52.191970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-332fb607-1a59-4c80-b3fb-ea91c9ecee58 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:52.194096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-332fb607-1a59-4c80-b3fb-ea91c9ecee58 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:52.213546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d918f4a2-8990-4505-a9cc-8229d71d6098 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1548 microversion: 2.1 time: 0.282465 Dec 15 16:23:52.222045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 219/429] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:51 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1548 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:52.230849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bff485c2-fe68-4ceb-a82d-b4bebde702f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:52.231683 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bff485c2-fe68-4ceb-a82d-b4bebde702f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:52.240961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bff485c2-fe68-4ceb-a82d-b4bebde702f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.241619 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bff485c2-fe68-4ceb-a82d-b4bebde702f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.242463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bff485c2-fe68-4ceb-a82d-b4bebde702f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.242912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bff485c2-fe68-4ceb-a82d-b4bebde702f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.290646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-332fb607-1a59-4c80-b3fb-ea91c9ecee58 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:52.298027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-332fb607-1a59-4c80-b3fb-ea91c9ecee58 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1214 microversion: 2.1 time: 0.114716 Dec 15 16:23:52.298616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 211/430] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:52 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:52.304873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-493d1b6f-0d34-4779-8aa3-9a16fbc87b99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:52.305756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-493d1b6f-0d34-4779-8aa3-9a16fbc87b99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:52.318568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-493d1b6f-0d34-4779-8aa3-9a16fbc87b99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.319064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-493d1b6f-0d34-4779-8aa3-9a16fbc87b99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.320347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-493d1b6f-0d34-4779-8aa3-9a16fbc87b99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.321115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-493d1b6f-0d34-4779-8aa3-9a16fbc87b99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.821777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bff485c2-fe68-4ceb-a82d-b4bebde702f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:52.830575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bff485c2-fe68-4ceb-a82d-b4bebde702f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.606958 Dec 15 16:23:52.831187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 220/431] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:52.836311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-be8e0641-9de2-458b-b57b-bd29f12729cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:52.836838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-be8e0641-9de2-458b-b57b-bd29f12729cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:52.845902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-493d1b6f-0d34-4779-8aa3-9a16fbc87b99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:52.850893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be8e0641-9de2-458b-b57b-bd29f12729cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.851355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be8e0641-9de2-458b-b57b-bd29f12729cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.852138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be8e0641-9de2-458b-b57b-bd29f12729cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.852599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be8e0641-9de2-458b-b57b-bd29f12729cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.855821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-493d1b6f-0d34-4779-8aa3-9a16fbc87b99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.555961 Dec 15 16:23:52.856546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 212/432] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:52.951381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:52.952018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:52.959415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.959855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.960684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.961113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.983707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-be8e0641-9de2-458b-b57b-bd29f12729cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] HTTP exception thrown: Cannot 'detach_volume' instance 7177930d-42eb-410e-a836-4287e9d78300 while it is in vm_state rescued Dec 15 16:23:52.984309 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-be8e0641-9de2-458b-b57b-bd29f12729cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Returning 409 to user: Cannot 'detach_volume' instance 7177930d-42eb-410e-a836-4287e9d78300 while it is in vm_state rescued {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:23:52.985162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-be8e0641-9de2-458b-b57b-bd29f12729cd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments/31455c68-75e7-4fff-a12c-6edf1cacfb44" status: 409 len: 152 microversion: 2.1 time: 0.152791 Dec 15 16:23:52.985724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 221/433] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Dec 15 16:23:52 2021] DELETE /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments/31455c68-75e7-4fff-a12c-6edf1cacfb44 => generated 152 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 16:23:52.994053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d1f6922a-ebb8-4364-84e3-f29879827fda tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:52.994576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d1f6922a-ebb8-4364-84e3-f29879827fda tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:53.004830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1f6922a-ebb8-4364-84e3-f29879827fda tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.005637 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1f6922a-ebb8-4364-84e3-f29879827fda tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.006801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1f6922a-ebb8-4364-84e3-f29879827fda tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.007233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1f6922a-ebb8-4364-84e3-f29879827fda tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.086268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d1f6922a-ebb8-4364-84e3-f29879827fda tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/action" status: 202 len: 0 microversion: 2.1 time: 0.095613 Dec 15 16:23:53.086925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 222/434] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:52 2021] POST /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:23:53.099215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ed7c15b6-c2c8-4e9c-bc48-0745a9b517fd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:53.099922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ed7c15b6-c2c8-4e9c-bc48-0745a9b517fd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:53.110435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed7c15b6-c2c8-4e9c-bc48-0745a9b517fd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.110435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed7c15b6-c2c8-4e9c-bc48-0745a9b517fd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.110435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed7c15b6-c2c8-4e9c-bc48-0745a9b517fd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.110435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed7c15b6-c2c8-4e9c-bc48-0745a9b517fd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.211376 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:53.224851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:53.226883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:53.228735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-25378384-ffb1-4b08-a5e4-79423e2d1388 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.281604 Dec 15 16:23:53.230331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 213/435] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:23:53.316782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aef7026a-ed4f-4b32-b642-1c7f72eff8b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:53.317743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aef7026a-ed4f-4b32-b642-1c7f72eff8b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:53.325765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aef7026a-ed4f-4b32-b642-1c7f72eff8b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.326611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aef7026a-ed4f-4b32-b642-1c7f72eff8b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.328335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aef7026a-ed4f-4b32-b642-1c7f72eff8b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.329085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aef7026a-ed4f-4b32-b642-1c7f72eff8b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.382492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ed7c15b6-c2c8-4e9c-bc48-0745a9b517fd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:53.394257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ed7c15b6-c2c8-4e9c-bc48-0745a9b517fd tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.300293 Dec 15 16:23:53.395944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 223/436] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:53 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:53.410295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-aef7026a-ed4f-4b32-b642-1c7f72eff8b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:53.421219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aef7026a-ed4f-4b32-b642-1c7f72eff8b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1266 microversion: 2.1 time: 0.109112 Dec 15 16:23:53.422594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 214/437] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:53 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:53.853475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5e70f685-bb36-41dd-8d81-0fe3730b23f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:53.854858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5e70f685-bb36-41dd-8d81-0fe3730b23f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:53.864478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e70f685-bb36-41dd-8d81-0fe3730b23f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.864948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e70f685-bb36-41dd-8d81-0fe3730b23f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.865757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e70f685-bb36-41dd-8d81-0fe3730b23f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.866227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e70f685-bb36-41dd-8d81-0fe3730b23f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.875379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4111d245-d1ea-4e3d-894f-54eaba80ed35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:53.876901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4111d245-d1ea-4e3d-894f-54eaba80ed35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:53.884819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4111d245-d1ea-4e3d-894f-54eaba80ed35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.885582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4111d245-d1ea-4e3d-894f-54eaba80ed35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.886847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4111d245-d1ea-4e3d-894f-54eaba80ed35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.887463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4111d245-d1ea-4e3d-894f-54eaba80ed35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.166045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5e70f685-bb36-41dd-8d81-0fe3730b23f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.173848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5e70f685-bb36-41dd-8d81-0fe3730b23f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.327586 Dec 15 16:23:54.184167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 224/438] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:53 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:54.229659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4111d245-d1ea-4e3d-894f-54eaba80ed35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.237602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4111d245-d1ea-4e3d-894f-54eaba80ed35 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.366328 Dec 15 16:23:54.239743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 215/439] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:53 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:54.248893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:54.249978 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:54.255970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.256266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.257187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.257618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.430306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5e1988ea-dcc9-4bb0-9388-542ec4582a4f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:54.434984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5e1988ea-dcc9-4bb0-9388-542ec4582a4f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:54.460710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e1988ea-dcc9-4bb0-9388-542ec4582a4f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.461967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e1988ea-dcc9-4bb0-9388-542ec4582a4f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.464390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e1988ea-dcc9-4bb0-9388-542ec4582a4f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.466389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e1988ea-dcc9-4bb0-9388-542ec4582a4f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.519957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.537845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.541920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.545990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3aecd5e7-0ae6-4015-ad1f-dbeaa2a23ecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.301822 Dec 15 16:23:54.551229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 225/440] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:54.557581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5c8e58f9-edec-4ba4-a793-9734749e2e01 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:54.561163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5c8e58f9-edec-4ba4-a793-9734749e2e01 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:54.585014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c8e58f9-edec-4ba4-a793-9734749e2e01 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.586063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c8e58f9-edec-4ba4-a793-9734749e2e01 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.588830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c8e58f9-edec-4ba4-a793-9734749e2e01 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.589958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c8e58f9-edec-4ba4-a793-9734749e2e01 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.729139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5c8e58f9-edec-4ba4-a793-9734749e2e01 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.741204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5c8e58f9-edec-4ba4-a793-9734749e2e01 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1272 microversion: 2.1 time: 0.186283 Dec 15 16:23:54.742145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 226/441] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:54 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:54.959788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5e1988ea-dcc9-4bb0-9388-542ec4582a4f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.973791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5e1988ea-dcc9-4bb0-9388-542ec4582a4f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.554966 Dec 15 16:23:54.974511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 216/442] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:54 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:55.199331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7fb24849-8167-4b63-9a12-8838db4d858a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:55.200061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7fb24849-8167-4b63-9a12-8838db4d858a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:55.209990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7fb24849-8167-4b63-9a12-8838db4d858a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.210478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7fb24849-8167-4b63-9a12-8838db4d858a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.211315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7fb24849-8167-4b63-9a12-8838db4d858a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.211738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7fb24849-8167-4b63-9a12-8838db4d858a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.255989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cffdfa82-2e9e-4a09-b000-2040bb1fda4a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:55.257700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cffdfa82-2e9e-4a09-b000-2040bb1fda4a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:55.270635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cffdfa82-2e9e-4a09-b000-2040bb1fda4a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.272641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cffdfa82-2e9e-4a09-b000-2040bb1fda4a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.272641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cffdfa82-2e9e-4a09-b000-2040bb1fda4a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.272641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cffdfa82-2e9e-4a09-b000-2040bb1fda4a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.411187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7fb24849-8167-4b63-9a12-8838db4d858a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:55.420229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7fb24849-8167-4b63-9a12-8838db4d858a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.225102 Dec 15 16:23:55.420973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 227/443] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:55.465193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cffdfa82-2e9e-4a09-b000-2040bb1fda4a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:55.473738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cffdfa82-2e9e-4a09-b000-2040bb1fda4a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.222418 Dec 15 16:23:55.474315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 217/444] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:55.572200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:55.573085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:55.579976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.580420 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.581266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.581922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.741384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:55.752119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:55.759124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4b7bd4f2-6977-4806-b339-3f3423189301 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:55.759750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4b7bd4f2-6977-4806-b339-3f3423189301 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:55.761737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:55.763848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2c741dd9-0467-486b-836d-1b2df100902c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.198195 Dec 15 16:23:55.765376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 228/445] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:55.767103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b7bd4f2-6977-4806-b339-3f3423189301 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.767765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b7bd4f2-6977-4806-b339-3f3423189301 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.769027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b7bd4f2-6977-4806-b339-3f3423189301 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.769785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b7bd4f2-6977-4806-b339-3f3423189301 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.914910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4b7bd4f2-6977-4806-b339-3f3423189301 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:55.923554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4b7bd4f2-6977-4806-b339-3f3423189301 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.168690 Dec 15 16:23:55.924518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 218/446] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:55 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:55.992748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4b0c4413-de0b-45fd-8714-c0e7924e7e33 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:55.993454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4b0c4413-de0b-45fd-8714-c0e7924e7e33 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:56.000898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b0c4413-de0b-45fd-8714-c0e7924e7e33 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.001492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b0c4413-de0b-45fd-8714-c0e7924e7e33 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.002545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b0c4413-de0b-45fd-8714-c0e7924e7e33 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.003058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b0c4413-de0b-45fd-8714-c0e7924e7e33 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.165010 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4b0c4413-de0b-45fd-8714-c0e7924e7e33 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:56.175033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4b0c4413-de0b-45fd-8714-c0e7924e7e33 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.187160 Dec 15 16:23:56.179894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 229/447] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:55 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:56.440118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-97b452a9-9bf6-47db-a7dd-609519a29ddf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:56.440835 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-97b452a9-9bf6-47db-a7dd-609519a29ddf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:56.447888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97b452a9-9bf6-47db-a7dd-609519a29ddf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.448345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97b452a9-9bf6-47db-a7dd-609519a29ddf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.449182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97b452a9-9bf6-47db-a7dd-609519a29ddf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.449620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97b452a9-9bf6-47db-a7dd-609519a29ddf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.496449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-de00af48-3a34-45f5-969d-2d2fb4a4849e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:56.497828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-de00af48-3a34-45f5-969d-2d2fb4a4849e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:56.505498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de00af48-3a34-45f5-969d-2d2fb4a4849e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.505943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de00af48-3a34-45f5-969d-2d2fb4a4849e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.506737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de00af48-3a34-45f5-969d-2d2fb4a4849e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.507162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de00af48-3a34-45f5-969d-2d2fb4a4849e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.662055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97b452a9-9bf6-47db-a7dd-609519a29ddf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:56.671142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-97b452a9-9bf6-47db-a7dd-609519a29ddf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.235573 Dec 15 16:23:56.681562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 219/448] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:56.687560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-946a509a-f5d9-46f3-a367-b9a84c27f8a9 req-45dea2db-5025-4c7c-8cae-14e4eb96d31f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4fd848-09ba-42aa-9176-dc8a60b95be2", "name": "network-vif-plugged", "status": "completed", "tag": "2c61efe0-6ed5-4b49-8a66-8e9f491633d4"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:56.689308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:56.689308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:23:56.698369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-946a509a-f5d9-46f3-a367-b9a84c27f8a9 req-45dea2db-5025-4c7c-8cae-14e4eb96d31f service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.699096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-946a509a-f5d9-46f3-a367-b9a84c27f8a9 req-45dea2db-5025-4c7c-8cae-14e4eb96d31f service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.710924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-946a509a-f5d9-46f3-a367-b9a84c27f8a9 req-45dea2db-5025-4c7c-8cae-14e4eb96d31f service nova] Creating event network-vif-plugged:2c61efe0-6ed5-4b49-8a66-8e9f491633d4 for instance 4c4fd848-09ba-42aa-9176-dc8a60b95be2 on hv-cinder-82002 Dec 15 16:23:56.716459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-946a509a-f5d9-46f3-a367-b9a84c27f8a9 req-45dea2db-5025-4c7c-8cae-14e4eb96d31f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 Dec 15 16:23:56.717182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 220/449] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:56.720815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-de00af48-3a34-45f5-969d-2d2fb4a4849e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:56.728423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-de00af48-3a34-45f5-969d-2d2fb4a4849e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.238744 Dec 15 16:23:56.729016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 230/450] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:56.783792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:56.784639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:56.792132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.792613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.793545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.794009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.951939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0b9db1d1-6472-4ffd-9bd1-3cb9f3c2b3ad tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:56.954243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0b9db1d1-6472-4ffd-9bd1-3cb9f3c2b3ad tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:56.963684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b9db1d1-6472-4ffd-9bd1-3cb9f3c2b3ad tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.964271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b9db1d1-6472-4ffd-9bd1-3cb9f3c2b3ad tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.965206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b9db1d1-6472-4ffd-9bd1-3cb9f3c2b3ad tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.965712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b9db1d1-6472-4ffd-9bd1-3cb9f3c2b3ad tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.976985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:56.997440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:56.999534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:57.001110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-73f2db85-5638-4d8a-8acf-93fea65b212d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.221739 Dec 15 16:23:57.001890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 221/451] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:57.130894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0b9db1d1-6472-4ffd-9bd1-3cb9f3c2b3ad tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:57.138819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0b9db1d1-6472-4ffd-9bd1-3cb9f3c2b3ad tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.194045 Dec 15 16:23:57.139389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 231/452] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:56 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:57.193881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-77ea14cc-bb17-4865-b7b4-92dde562aa0f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:57.194552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-77ea14cc-bb17-4865-b7b4-92dde562aa0f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:57.200934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77ea14cc-bb17-4865-b7b4-92dde562aa0f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.201380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77ea14cc-bb17-4865-b7b4-92dde562aa0f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.202171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77ea14cc-bb17-4865-b7b4-92dde562aa0f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.202606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77ea14cc-bb17-4865-b7b4-92dde562aa0f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.370079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-77ea14cc-bb17-4865-b7b4-92dde562aa0f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:57.379494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-77ea14cc-bb17-4865-b7b4-92dde562aa0f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.189584 Dec 15 16:23:57.380363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 222/453] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:57 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:57.689110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d3150d50-a743-4df9-8999-ba9d1dfc3113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:57.689924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d3150d50-a743-4df9-8999-ba9d1dfc3113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:57.697545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3150d50-a743-4df9-8999-ba9d1dfc3113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.698090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3150d50-a743-4df9-8999-ba9d1dfc3113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.698944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3150d50-a743-4df9-8999-ba9d1dfc3113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.699462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3150d50-a743-4df9-8999-ba9d1dfc3113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.746496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-167ffd05-3978-4932-a6bf-cbba89bdc469 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:57.747398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-167ffd05-3978-4932-a6bf-cbba89bdc469 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:57.756882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-167ffd05-3978-4932-a6bf-cbba89bdc469 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.757692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-167ffd05-3978-4932-a6bf-cbba89bdc469 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.758808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-167ffd05-3978-4932-a6bf-cbba89bdc469 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.759481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-167ffd05-3978-4932-a6bf-cbba89bdc469 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.911189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d3150d50-a743-4df9-8999-ba9d1dfc3113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:57.927769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d3150d50-a743-4df9-8999-ba9d1dfc3113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.242061 Dec 15 16:23:57.929093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 232/454] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:57.978387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-167ffd05-3978-4932-a6bf-cbba89bdc469 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:57.986926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-167ffd05-3978-4932-a6bf-cbba89bdc469 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.244605 Dec 15 16:23:57.987808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 223/455] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:58.025170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:58.025978 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:58.032813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.033268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.034092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.034536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.156359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-31288eb0-d597-4ea7-9cc7-959d0f9caff5 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:58.157387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-31288eb0-d597-4ea7-9cc7-959d0f9caff5 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:58.163874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31288eb0-d597-4ea7-9cc7-959d0f9caff5 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.164618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31288eb0-d597-4ea7-9cc7-959d0f9caff5 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.165435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31288eb0-d597-4ea7-9cc7-959d0f9caff5 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.165862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31288eb0-d597-4ea7-9cc7-959d0f9caff5 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.193506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:58.202147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:58.203646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:58.204843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-71639507-a2d3-4957-b7b9-e4c9ae7f74bf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.183722 Dec 15 16:23:58.205414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 233/456] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:58.341007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-31288eb0-d597-4ea7-9cc7-959d0f9caff5 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:58.349576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-31288eb0-d597-4ea7-9cc7-959d0f9caff5 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.196869 Dec 15 16:23:58.350158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 224/457] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:58 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:58.397508 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2d5dab8c-0bbf-45bc-90d0-ad12e3995e52 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:58.398113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2d5dab8c-0bbf-45bc-90d0-ad12e3995e52 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:58.405329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d5dab8c-0bbf-45bc-90d0-ad12e3995e52 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.405775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d5dab8c-0bbf-45bc-90d0-ad12e3995e52 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.406840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d5dab8c-0bbf-45bc-90d0-ad12e3995e52 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.407356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d5dab8c-0bbf-45bc-90d0-ad12e3995e52 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.570646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2d5dab8c-0bbf-45bc-90d0-ad12e3995e52 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:58.580091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2d5dab8c-0bbf-45bc-90d0-ad12e3995e52 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.186233 Dec 15 16:23:58.580866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 234/458] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:58 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:58.954034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-42214344-0978-4298-bc74-61712710f0ea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:58.954694 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-42214344-0978-4298-bc74-61712710f0ea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:58.961623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42214344-0978-4298-bc74-61712710f0ea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.962066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42214344-0978-4298-bc74-61712710f0ea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.962855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42214344-0978-4298-bc74-61712710f0ea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.963278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42214344-0978-4298-bc74-61712710f0ea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.004980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cb0cf803-cf1f-4780-ae7e-60aadb4a1822 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:59.005627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cb0cf803-cf1f-4780-ae7e-60aadb4a1822 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:59.012374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb0cf803-cf1f-4780-ae7e-60aadb4a1822 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.012897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb0cf803-cf1f-4780-ae7e-60aadb4a1822 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.013695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb0cf803-cf1f-4780-ae7e-60aadb4a1822 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.014142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb0cf803-cf1f-4780-ae7e-60aadb4a1822 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.147493 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-42214344-0978-4298-bc74-61712710f0ea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:59.156249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-42214344-0978-4298-bc74-61712710f0ea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.205798 Dec 15 16:23:59.161237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 225/459] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:59.202986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cb0cf803-cf1f-4780-ae7e-60aadb4a1822 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:59.212333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cb0cf803-cf1f-4780-ae7e-60aadb4a1822 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.210932 Dec 15 16:23:59.212795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 235/460] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:59.223796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:59.224534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:59.231973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.232401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.233656 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.234097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.367365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0e7a181d-79ba-4902-a26c-d476088c0978 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:59.368296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0e7a181d-79ba-4902-a26c-d476088c0978 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:59.375090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e7a181d-79ba-4902-a26c-d476088c0978 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.389295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e7a181d-79ba-4902-a26c-d476088c0978 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.390174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e7a181d-79ba-4902-a26c-d476088c0978 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.390618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e7a181d-79ba-4902-a26c-d476088c0978 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.396698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:59.410271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:59.411851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:59.413489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9dff58b3-ce31-4bd9-946c-a3d8bf702113 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.193822 Dec 15 16:23:59.414680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 226/461] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:23:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:23:59.534164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0e7a181d-79ba-4902-a26c-d476088c0978 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:59.543084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0e7a181d-79ba-4902-a26c-d476088c0978 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.180058 Dec 15 16:23:59.543917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 236/462] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:59 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:59.598782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bf9defbf-17ca-4417-8867-2bd069dc0521 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:59.599518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bf9defbf-17ca-4417-8867-2bd069dc0521 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:59.606312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bf9defbf-17ca-4417-8867-2bd069dc0521 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.606752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bf9defbf-17ca-4417-8867-2bd069dc0521 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.607549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bf9defbf-17ca-4417-8867-2bd069dc0521 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.607979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bf9defbf-17ca-4417-8867-2bd069dc0521 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.776189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bf9defbf-17ca-4417-8867-2bd069dc0521 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:59.785290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bf9defbf-17ca-4417-8867-2bd069dc0521 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.190534 Dec 15 16:23:59.785873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 227/463] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:59 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:00.174794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa542b2f-0b2e-41ed-9dc4-7568aeacafb9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:00.175495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa542b2f-0b2e-41ed-9dc4-7568aeacafb9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:00.182517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa542b2f-0b2e-41ed-9dc4-7568aeacafb9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.182964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa542b2f-0b2e-41ed-9dc4-7568aeacafb9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.183742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa542b2f-0b2e-41ed-9dc4-7568aeacafb9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.184177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa542b2f-0b2e-41ed-9dc4-7568aeacafb9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.229499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7ba4a8b3-7d99-49a1-b393-e27895f0ab3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:00.230236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7ba4a8b3-7d99-49a1-b393-e27895f0ab3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:00.238260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ba4a8b3-7d99-49a1-b393-e27895f0ab3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.238708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ba4a8b3-7d99-49a1-b393-e27895f0ab3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.239627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ba4a8b3-7d99-49a1-b393-e27895f0ab3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.240489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ba4a8b3-7d99-49a1-b393-e27895f0ab3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.378314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa542b2f-0b2e-41ed-9dc4-7568aeacafb9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.386979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa542b2f-0b2e-41ed-9dc4-7568aeacafb9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.215866 Dec 15 16:24:00.387566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 237/464] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:00.424824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7ba4a8b3-7d99-49a1-b393-e27895f0ab3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.435638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7ba4a8b3-7d99-49a1-b393-e27895f0ab3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.209913 Dec 15 16:24:00.436215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 228/465] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:00.437571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:00.439319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:00.448481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.449178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.450062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.450558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.560420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-53d0ff3a-09f9-438a-baf4-a689a1bba197 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:00.561076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-53d0ff3a-09f9-438a-baf4-a689a1bba197 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:00.567353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53d0ff3a-09f9-438a-baf4-a689a1bba197 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.568221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53d0ff3a-09f9-438a-baf4-a689a1bba197 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.569517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53d0ff3a-09f9-438a-baf4-a689a1bba197 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.569955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53d0ff3a-09f9-438a-baf4-a689a1bba197 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.623844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.636313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.637823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.639009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7cafaa5c-3b8f-45c6-83e6-c00a0797df36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.210263 Dec 15 16:24:00.639589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 238/466] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:00.730551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-53d0ff3a-09f9-438a-baf4-a689a1bba197 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.740729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-53d0ff3a-09f9-438a-baf4-a689a1bba197 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.183756 Dec 15 16:24:00.742167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 229/467] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:00 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:00.811164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9baf5ee5-6644-4d4f-a6c5-6d0c7938542a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:00.811946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9baf5ee5-6644-4d4f-a6c5-6d0c7938542a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:00.820169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9baf5ee5-6644-4d4f-a6c5-6d0c7938542a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.820637 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9baf5ee5-6644-4d4f-a6c5-6d0c7938542a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.821413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9baf5ee5-6644-4d4f-a6c5-6d0c7938542a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.821876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9baf5ee5-6644-4d4f-a6c5-6d0c7938542a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.958728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9baf5ee5-6644-4d4f-a6c5-6d0c7938542a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.967098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9baf5ee5-6644-4d4f-a6c5-6d0c7938542a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.161845 Dec 15 16:24:00.967667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 239/468] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:00 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:01.404734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-390ed0e0-0e3a-44c4-9474-860cf8303f77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:01.405395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-390ed0e0-0e3a-44c4-9474-860cf8303f77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:01.412817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-390ed0e0-0e3a-44c4-9474-860cf8303f77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.413337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-390ed0e0-0e3a-44c4-9474-860cf8303f77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.414136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-390ed0e0-0e3a-44c4-9474-860cf8303f77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.414584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-390ed0e0-0e3a-44c4-9474-860cf8303f77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.453372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-982cf10c-da18-4f04-a4b4-eae7168e7153 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:01.454076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-982cf10c-da18-4f04-a4b4-eae7168e7153 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:01.462524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-982cf10c-da18-4f04-a4b4-eae7168e7153 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.463055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-982cf10c-da18-4f04-a4b4-eae7168e7153 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.463902 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-982cf10c-da18-4f04-a4b4-eae7168e7153 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.464411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-982cf10c-da18-4f04-a4b4-eae7168e7153 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.594197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-390ed0e0-0e3a-44c4-9474-860cf8303f77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:01.602482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-390ed0e0-0e3a-44c4-9474-860cf8303f77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.201434 Dec 15 16:24:01.603052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 230/469] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:01.645179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-982cf10c-da18-4f04-a4b4-eae7168e7153 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:01.653105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-982cf10c-da18-4f04-a4b4-eae7168e7153 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.203359 Dec 15 16:24:01.653686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 240/470] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:01.662356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:01.662853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:01.669254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.669699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.670494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.670935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.762108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4ec39093-2887-4b0c-9c8c-3c384228efbc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:01.763279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4ec39093-2887-4b0c-9c8c-3c384228efbc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:01.772724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ec39093-2887-4b0c-9c8c-3c384228efbc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.773226 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ec39093-2887-4b0c-9c8c-3c384228efbc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.774303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ec39093-2887-4b0c-9c8c-3c384228efbc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.774571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ec39093-2887-4b0c-9c8c-3c384228efbc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.871540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:01.882368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:01.884579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:01.885853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-910e1b84-589c-407c-8e19-6111ad08d43b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.227433 Dec 15 16:24:01.886745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 231/471] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:01.952156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4ec39093-2887-4b0c-9c8c-3c384228efbc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:01.962376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4ec39093-2887-4b0c-9c8c-3c384228efbc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.207262 Dec 15 16:24:01.969685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 241/472] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:01 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:01.986639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1847731f-1e81-4ddb-9bec-7a428b5cdaf1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:01.987261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1847731f-1e81-4ddb-9bec-7a428b5cdaf1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:01.994543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1847731f-1e81-4ddb-9bec-7a428b5cdaf1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.994993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1847731f-1e81-4ddb-9bec-7a428b5cdaf1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.995800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1847731f-1e81-4ddb-9bec-7a428b5cdaf1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.996235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1847731f-1e81-4ddb-9bec-7a428b5cdaf1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.175396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1847731f-1e81-4ddb-9bec-7a428b5cdaf1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:02.185057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1847731f-1e81-4ddb-9bec-7a428b5cdaf1 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.202675 Dec 15 16:24:02.185660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 232/473] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:01 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:02.626663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8d81145f-38b2-4afe-80b1-bdc18beb9397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:02.627680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8d81145f-38b2-4afe-80b1-bdc18beb9397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:02.639302 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8d81145f-38b2-4afe-80b1-bdc18beb9397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.639754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8d81145f-38b2-4afe-80b1-bdc18beb9397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.640614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8d81145f-38b2-4afe-80b1-bdc18beb9397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.641059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8d81145f-38b2-4afe-80b1-bdc18beb9397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.670264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3d3b9522-d67b-4087-8d50-5af279e364c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:02.670973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3d3b9522-d67b-4087-8d50-5af279e364c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:02.680079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d3b9522-d67b-4087-8d50-5af279e364c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.680682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d3b9522-d67b-4087-8d50-5af279e364c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.681581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d3b9522-d67b-4087-8d50-5af279e364c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.682069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d3b9522-d67b-4087-8d50-5af279e364c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.945222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8d81145f-38b2-4afe-80b1-bdc18beb9397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:02.954784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8d81145f-38b2-4afe-80b1-bdc18beb9397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.335687 Dec 15 16:24:02.955399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 242/474] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:02.960834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:02.961446 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:02.967479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.967936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.968769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.969200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.979308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3d3b9522-d67b-4087-8d50-5af279e364c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:02.987739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3d3b9522-d67b-4087-8d50-5af279e364c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.321084 Dec 15 16:24:02.988302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 233/475] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:02.992770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7972a929-0afb-4983-b412-61b9153fb46d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:02.993380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7972a929-0afb-4983-b412-61b9153fb46d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:02.999589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7972a929-0afb-4983-b412-61b9153fb46d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.000034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7972a929-0afb-4983-b412-61b9153fb46d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:03.000861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7972a929-0afb-4983-b412-61b9153fb46d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.001295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7972a929-0afb-4983-b412-61b9153fb46d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:03.166857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:03.176461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:03.178154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:03.179344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fa1f6ddb-7f3e-43c6-8fcb-5a3281ccba0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.222889 Dec 15 16:24:03.179955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 243/476] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:03.204109 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7972a929-0afb-4983-b412-61b9153fb46d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:03.208014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-46e5aeae-c8e7-45b0-a22f-01b16b759ed2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:03.209436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-46e5aeae-c8e7-45b0-a22f-01b16b759ed2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:03.213143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7972a929-0afb-4983-b412-61b9153fb46d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.223507 Dec 15 16:24:03.213942 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 234/477] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:02 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:03.218098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46e5aeae-c8e7-45b0-a22f-01b16b759ed2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.218610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46e5aeae-c8e7-45b0-a22f-01b16b759ed2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:03.219522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46e5aeae-c8e7-45b0-a22f-01b16b759ed2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.220021 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46e5aeae-c8e7-45b0-a22f-01b16b759ed2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:03.377347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-46e5aeae-c8e7-45b0-a22f-01b16b759ed2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:03.386097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-46e5aeae-c8e7-45b0-a22f-01b16b759ed2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.185491 Dec 15 16:24:03.386676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 244/478] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:03 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:03.976462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-96c3e93c-7628-4d5d-8690-ad81cea57092 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:03.977456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-96c3e93c-7628-4d5d-8690-ad81cea57092 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:03.989104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96c3e93c-7628-4d5d-8690-ad81cea57092 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.989976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96c3e93c-7628-4d5d-8690-ad81cea57092 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:03.991667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96c3e93c-7628-4d5d-8690-ad81cea57092 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.992381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96c3e93c-7628-4d5d-8690-ad81cea57092 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.007069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3454f617-619f-401e-a69a-75dfb830ad08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:04.008101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3454f617-619f-401e-a69a-75dfb830ad08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:04.023901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3454f617-619f-401e-a69a-75dfb830ad08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.024747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3454f617-619f-401e-a69a-75dfb830ad08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.026049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3454f617-619f-401e-a69a-75dfb830ad08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.026768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3454f617-619f-401e-a69a-75dfb830ad08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.237121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-96c3e93c-7628-4d5d-8690-ad81cea57092 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:04.247936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-96c3e93c-7628-4d5d-8690-ad81cea57092 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.278538 Dec 15 16:24:04.248893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 235/479] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:04.253556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:04.254175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:04.254288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3454f617-619f-401e-a69a-75dfb830ad08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:04.262762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.263319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.264556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.264985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.268075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3454f617-619f-401e-a69a-75dfb830ad08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.265416 Dec 15 16:24:04.268869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 245/480] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:04.279215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0e5114fd-eaed-434b-b931-83421b7b292a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:04.280336 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0e5114fd-eaed-434b-b931-83421b7b292a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:04.290786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e5114fd-eaed-434b-b931-83421b7b292a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.290786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e5114fd-eaed-434b-b931-83421b7b292a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.291291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e5114fd-eaed-434b-b931-83421b7b292a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.291738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e5114fd-eaed-434b-b931-83421b7b292a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.496890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:04.510930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0e5114fd-eaed-434b-b931-83421b7b292a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:04.512197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:04.513901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:04.515212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-170f6646-7979-4b61-908e-db237051fece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.265355 Dec 15 16:24:04.521295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 236/481] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:04.521607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0e5114fd-eaed-434b-b931-83421b7b292a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.249439 Dec 15 16:24:04.521805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7aa9e3f2-cba5-48ca-a3a7-56ef931b1833 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:04.521805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7aa9e3f2-cba5-48ca-a3a7-56ef931b1833 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:04.527986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7aa9e3f2-cba5-48ca-a3a7-56ef931b1833 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.528482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7aa9e3f2-cba5-48ca-a3a7-56ef931b1833 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.529329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7aa9e3f2-cba5-48ca-a3a7-56ef931b1833 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.529708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7aa9e3f2-cba5-48ca-a3a7-56ef931b1833 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.532540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 246/482] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:04 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:04.680609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7aa9e3f2-cba5-48ca-a3a7-56ef931b1833 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:04.689317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7aa9e3f2-cba5-48ca-a3a7-56ef931b1833 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.171952 Dec 15 16:24:04.689975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 237/483] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:04 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:04.752633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fbab0a72-9a3b-440f-90c2-c518bb9bd004 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "076e1b16-eab6-44c8-9856-755b75a5da30", "device": "/dev/sdb"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:04.754238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fbab0a72-9a3b-440f-90c2-c518bb9bd004 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:04.760963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbab0a72-9a3b-440f-90c2-c518bb9bd004 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.761401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbab0a72-9a3b-440f-90c2-c518bb9bd004 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.762204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbab0a72-9a3b-440f-90c2-c518bb9bd004 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:04.762634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbab0a72-9a3b-440f-90c2-c518bb9bd004 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.277669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2f919e1b-8f41-4bbf-bc94-c7f449ab4bf8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.278350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2f919e1b-8f41-4bbf-bc94-c7f449ab4bf8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.285105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f919e1b-8f41-4bbf-bc94-c7f449ab4bf8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.285558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f919e1b-8f41-4bbf-bc94-c7f449ab4bf8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.286380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f919e1b-8f41-4bbf-bc94-c7f449ab4bf8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.287104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f919e1b-8f41-4bbf-bc94-c7f449ab4bf8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.464687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2f919e1b-8f41-4bbf-bc94-c7f449ab4bf8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:05.475204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2f919e1b-8f41-4bbf-bc94-c7f449ab4bf8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.202303 Dec 15 16:24:05.475814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 238/484] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:05.480927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-22ce7630-7bff-4d22-a152-4cbdce8d9574 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.481652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-22ce7630-7bff-4d22-a152-4cbdce8d9574 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.489795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-22ce7630-7bff-4d22-a152-4cbdce8d9574 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.490901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-22ce7630-7bff-4d22-a152-4cbdce8d9574 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.492715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-22ce7630-7bff-4d22-a152-4cbdce8d9574 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.493253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-22ce7630-7bff-4d22-a152-4cbdce8d9574 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.651047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-22ce7630-7bff-4d22-a152-4cbdce8d9574 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:05.658945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-22ce7630-7bff-4d22-a152-4cbdce8d9574 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.182039 Dec 15 16:24:05.659673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 239/485] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:05.664246 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.664890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.671434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.671883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.672725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.673164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.838342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:05.849312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:05.851214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:05.852907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3a6b3d26-6204-4c08-8fdd-15f8bee52a76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.192116 Dec 15 16:24:05.853626 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 240/486] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:05.863176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-13000380-4eef-4847-b25d-ba3dd3e9624a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.864249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-13000380-4eef-4847-b25d-ba3dd3e9624a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.872485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-13000380-4eef-4847-b25d-ba3dd3e9624a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.873205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-13000380-4eef-4847-b25d-ba3dd3e9624a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.874579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-13000380-4eef-4847-b25d-ba3dd3e9624a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.875317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-13000380-4eef-4847-b25d-ba3dd3e9624a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.101160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-13000380-4eef-4847-b25d-ba3dd3e9624a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:06.110074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-13000380-4eef-4847-b25d-ba3dd3e9624a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.254887 Dec 15 16:24:06.110674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 241/487] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:05 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:06.115356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e12e9d0a-31c0-4b3c-be8c-734a230cb7ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:06.115979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e12e9d0a-31c0-4b3c-be8c-734a230cb7ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:06.128781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e12e9d0a-31c0-4b3c-be8c-734a230cb7ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.129251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e12e9d0a-31c0-4b3c-be8c-734a230cb7ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.130131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e12e9d0a-31c0-4b3c-be8c-734a230cb7ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.130583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e12e9d0a-31c0-4b3c-be8c-734a230cb7ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.339245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e12e9d0a-31c0-4b3c-be8c-734a230cb7ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:06.347757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e12e9d0a-31c0-4b3c-be8c-734a230cb7ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.236015 Dec 15 16:24:06.348352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 242/488] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:06 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:06.506426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ba77fe49-d846-4ea0-9b04-b3b38e48a937 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:06.507521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ba77fe49-d846-4ea0-9b04-b3b38e48a937 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:06.520312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba77fe49-d846-4ea0-9b04-b3b38e48a937 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.521300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba77fe49-d846-4ea0-9b04-b3b38e48a937 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.522824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba77fe49-d846-4ea0-9b04-b3b38e48a937 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.524090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba77fe49-d846-4ea0-9b04-b3b38e48a937 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.711664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ba77fe49-d846-4ea0-9b04-b3b38e48a937 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:06.729214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ba77fe49-d846-4ea0-9b04-b3b38e48a937 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.228945 Dec 15 16:24:06.730215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 243/489] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:06.738876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-711c0ca2-2745-4b9b-a60f-223bcfccb4ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:06.739996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-711c0ca2-2745-4b9b-a60f-223bcfccb4ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:06.751204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-711c0ca2-2745-4b9b-a60f-223bcfccb4ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.751991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-711c0ca2-2745-4b9b-a60f-223bcfccb4ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.753405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-711c0ca2-2745-4b9b-a60f-223bcfccb4ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.754219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-711c0ca2-2745-4b9b-a60f-223bcfccb4ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.955836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-711c0ca2-2745-4b9b-a60f-223bcfccb4ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:06.964079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-711c0ca2-2745-4b9b-a60f-223bcfccb4ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.232350 Dec 15 16:24:06.964700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 244/490] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:06.969119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:06.969862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:06.981528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.982306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.984101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.984912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.147652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:07.159818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:07.162597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:07.164783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a081d4f4-e356-4fb3-8235-cc249eba151b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.198792 Dec 15 16:24:07.165794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 245/491] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:07.173871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b630710e-2446-4b92-8ff7-b31f0d7dbb2d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:07.174979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b630710e-2446-4b92-8ff7-b31f0d7dbb2d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:07.185571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b630710e-2446-4b92-8ff7-b31f0d7dbb2d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.186524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b630710e-2446-4b92-8ff7-b31f0d7dbb2d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.187381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b630710e-2446-4b92-8ff7-b31f0d7dbb2d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.187850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b630710e-2446-4b92-8ff7-b31f0d7dbb2d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.378162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b630710e-2446-4b92-8ff7-b31f0d7dbb2d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:07.387921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b630710e-2446-4b92-8ff7-b31f0d7dbb2d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.220663 Dec 15 16:24:07.388566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 246/492] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:07 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:07.392935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-40cb4bea-9903-489d-893d-d2981ea60522 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:07.393535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-40cb4bea-9903-489d-893d-d2981ea60522 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:07.404222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40cb4bea-9903-489d-893d-d2981ea60522 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.404711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40cb4bea-9903-489d-893d-d2981ea60522 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.405719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40cb4bea-9903-489d-893d-d2981ea60522 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.406158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40cb4bea-9903-489d-893d-d2981ea60522 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.550495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-40cb4bea-9903-489d-893d-d2981ea60522 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:07.558964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-40cb4bea-9903-489d-893d-d2981ea60522 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.169357 Dec 15 16:24:07.559556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 247/493] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:07 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:07.747934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0f2489ef-330d-4a48-bfb5-7b31bc7f817c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:07.748568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0f2489ef-330d-4a48-bfb5-7b31bc7f817c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:07.755354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f2489ef-330d-4a48-bfb5-7b31bc7f817c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.756047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f2489ef-330d-4a48-bfb5-7b31bc7f817c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.762045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f2489ef-330d-4a48-bfb5-7b31bc7f817c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.762521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f2489ef-330d-4a48-bfb5-7b31bc7f817c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.920053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0f2489ef-330d-4a48-bfb5-7b31bc7f817c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:07.928723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0f2489ef-330d-4a48-bfb5-7b31bc7f817c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.184572 Dec 15 16:24:07.929270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 248/494] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:07.981967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5ddbb147-96db-4461-b68b-9a8d31606e89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:07.982577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5ddbb147-96db-4461-b68b-9a8d31606e89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:07.989524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ddbb147-96db-4461-b68b-9a8d31606e89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.990433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ddbb147-96db-4461-b68b-9a8d31606e89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.990868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ddbb147-96db-4461-b68b-9a8d31606e89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.991303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ddbb147-96db-4461-b68b-9a8d31606e89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.142377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5ddbb147-96db-4461-b68b-9a8d31606e89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:08.151035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5ddbb147-96db-4461-b68b-9a8d31606e89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.172662 Dec 15 16:24:08.151843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 249/495] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:07 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:08.188360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:08.189005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:08.196795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.197240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.198030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.198455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.352169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:08.361553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:08.363024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:08.364216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-63e16837-8c92-4223-b13a-3a0ec0f0b88a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.179662 Dec 15 16:24:08.366143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 250/496] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:08.405877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f2c223c7-5700-4b2c-9ed2-02b685c1ee3d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:08.406542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f2c223c7-5700-4b2c-9ed2-02b685c1ee3d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:08.413492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2c223c7-5700-4b2c-9ed2-02b685c1ee3d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.413938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2c223c7-5700-4b2c-9ed2-02b685c1ee3d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.414774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2c223c7-5700-4b2c-9ed2-02b685c1ee3d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.415192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2c223c7-5700-4b2c-9ed2-02b685c1ee3d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.567692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f2c223c7-5700-4b2c-9ed2-02b685c1ee3d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:08.578229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f2c223c7-5700-4b2c-9ed2-02b685c1ee3d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.175922 Dec 15 16:24:08.579196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 251/497] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:08 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:08.585194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8bb355ba-8a97-4b98-97d9-b07f354cc15e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:08.586081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8bb355ba-8a97-4b98-97d9-b07f354cc15e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:08.592772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bb355ba-8a97-4b98-97d9-b07f354cc15e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.593253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bb355ba-8a97-4b98-97d9-b07f354cc15e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.594104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bb355ba-8a97-4b98-97d9-b07f354cc15e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.594536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bb355ba-8a97-4b98-97d9-b07f354cc15e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.739103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8bb355ba-8a97-4b98-97d9-b07f354cc15e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:08.749359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8bb355ba-8a97-4b98-97d9-b07f354cc15e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.168786 Dec 15 16:24:08.749988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 252/498] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:08 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:08.947612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bd665597-43bc-4e14-a277-10c8313b985e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:08.948124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bd665597-43bc-4e14-a277-10c8313b985e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:08.954459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd665597-43bc-4e14-a277-10c8313b985e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.954905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd665597-43bc-4e14-a277-10c8313b985e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.955675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd665597-43bc-4e14-a277-10c8313b985e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.956218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd665597-43bc-4e14-a277-10c8313b985e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.112640 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bd665597-43bc-4e14-a277-10c8313b985e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:09.123355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bd665597-43bc-4e14-a277-10c8313b985e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.179595 Dec 15 16:24:09.124387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 253/499] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:09.167340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f937b027-64c7-40e0-92f3-75c469da00df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:09.167940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f937b027-64c7-40e0-92f3-75c469da00df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:09.174073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f937b027-64c7-40e0-92f3-75c469da00df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.174522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f937b027-64c7-40e0-92f3-75c469da00df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.175351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f937b027-64c7-40e0-92f3-75c469da00df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.175778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f937b027-64c7-40e0-92f3-75c469da00df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.348159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f937b027-64c7-40e0-92f3-75c469da00df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:09.359128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f937b027-64c7-40e0-92f3-75c469da00df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.194896 Dec 15 16:24:09.359863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 254/500] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:09.383698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:09.384323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:09.391560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.392008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.392861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.393291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.538113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:09.546889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:09.548375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:09.549581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fbf34726-d5bc-4e97-8af4-5960ffb76bc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.169890 Dec 15 16:24:09.550143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 255/501] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:24:09.603865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-858a4161-0b98-47e3-ba2e-06caac9e11d4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:09.604683 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-858a4161-0b98-47e3-ba2e-06caac9e11d4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:09.612020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-858a4161-0b98-47e3-ba2e-06caac9e11d4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.612497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-858a4161-0b98-47e3-ba2e-06caac9e11d4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.613290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-858a4161-0b98-47e3-ba2e-06caac9e11d4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.613764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-858a4161-0b98-47e3-ba2e-06caac9e11d4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.766558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-858a4161-0b98-47e3-ba2e-06caac9e11d4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:09.775519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-858a4161-0b98-47e3-ba2e-06caac9e11d4 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.175807 Dec 15 16:24:09.776133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 256/502] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:09 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:09.781093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-494b6087-611c-4395-9e7f-395d580eb430 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:09.781742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-494b6087-611c-4395-9e7f-395d580eb430 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:09.792978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-494b6087-611c-4395-9e7f-395d580eb430 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.793447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-494b6087-611c-4395-9e7f-395d580eb430 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.794129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-494b6087-611c-4395-9e7f-395d580eb430 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.794570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-494b6087-611c-4395-9e7f-395d580eb430 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.944672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-494b6087-611c-4395-9e7f-395d580eb430 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:09.953033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-494b6087-611c-4395-9e7f-395d580eb430 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.175791 Dec 15 16:24:09.953621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 257/503] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:09 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:10.141714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2e05a5fa-795b-4875-b8be-3f62499ef6fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:10.142328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2e05a5fa-795b-4875-b8be-3f62499ef6fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:10.149540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e05a5fa-795b-4875-b8be-3f62499ef6fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.149987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e05a5fa-795b-4875-b8be-3f62499ef6fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.150799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e05a5fa-795b-4875-b8be-3f62499ef6fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.151225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e05a5fa-795b-4875-b8be-3f62499ef6fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.300264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2e05a5fa-795b-4875-b8be-3f62499ef6fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:10.309534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2e05a5fa-795b-4875-b8be-3f62499ef6fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1725 microversion: 2.1 time: 0.171371 Dec 15 16:24:10.310118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 258/504] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:10.377531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-265cb606-9267-4eed-a75b-7a4537e4b821 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:10.378148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-265cb606-9267-4eed-a75b-7a4537e4b821 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:10.385534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-265cb606-9267-4eed-a75b-7a4537e4b821 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.385981 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-265cb606-9267-4eed-a75b-7a4537e4b821 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.386795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-265cb606-9267-4eed-a75b-7a4537e4b821 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.387226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-265cb606-9267-4eed-a75b-7a4537e4b821 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.538300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-265cb606-9267-4eed-a75b-7a4537e4b821 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:10.546427 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-265cb606-9267-4eed-a75b-7a4537e4b821 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.172659 Dec 15 16:24:10.547015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 259/505] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:10.569652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:10.569913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:10.577018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.577459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.579717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.580151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.750666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:10.764783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:10.766591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:10.767843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-73630f51-65ae-4194-bac5-08ce398d8445 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.202829 Dec 15 16:24:10.768656 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 260/506] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:10.796196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-462fef36-250e-4eef-a19a-d9fdb97ac049 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:10.799305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-462fef36-250e-4eef-a19a-d9fdb97ac049 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:10.810700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-462fef36-250e-4eef-a19a-d9fdb97ac049 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.811065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-462fef36-250e-4eef-a19a-d9fdb97ac049 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.811865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-462fef36-250e-4eef-a19a-d9fdb97ac049 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.812298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-462fef36-250e-4eef-a19a-d9fdb97ac049 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.067897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fbab0a72-9a3b-440f-90c2-c518bb9bd004 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "POST /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.318900 Dec 15 16:24:11.088289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 247/507] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Dec 15 16:24:04 2021] POST /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2/os-volume_attachments => generated 194 bytes in 6340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:11.094438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e981d426-8a3c-4ca2-ae60-029a077072ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:11.103685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e981d426-8a3c-4ca2-ae60-029a077072ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:11.123409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e981d426-8a3c-4ca2-ae60-029a077072ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.124257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e981d426-8a3c-4ca2-ae60-029a077072ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.126466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e981d426-8a3c-4ca2-ae60-029a077072ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.127371 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e981d426-8a3c-4ca2-ae60-029a077072ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.467988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-462fef36-250e-4eef-a19a-d9fdb97ac049 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:11.476328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-462fef36-250e-4eef-a19a-d9fdb97ac049 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.683532 Dec 15 16:24:11.477042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 261/508] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:10 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:11.482062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-00340fc1-56c2-4997-862e-ab8bf972c537 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:11.482671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-00340fc1-56c2-4997-862e-ab8bf972c537 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:11.489951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00340fc1-56c2-4997-862e-ab8bf972c537 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.490719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00340fc1-56c2-4997-862e-ab8bf972c537 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.491716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00340fc1-56c2-4997-862e-ab8bf972c537 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.492146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00340fc1-56c2-4997-862e-ab8bf972c537 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.633834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e981d426-8a3c-4ca2-ae60-029a077072ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:11.642930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e981d426-8a3c-4ca2-ae60-029a077072ea tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.553039 Dec 15 16:24:11.652282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 248/509] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:11 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:11.652282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-12f15304-95f6-45f7-9f50-75cc4e9ab496 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:11.652282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-12f15304-95f6-45f7-9f50-75cc4e9ab496 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:11.656281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-12f15304-95f6-45f7-9f50-75cc4e9ab496 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.656778 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-12f15304-95f6-45f7-9f50-75cc4e9ab496 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.657590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-12f15304-95f6-45f7-9f50-75cc4e9ab496 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.658015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-12f15304-95f6-45f7-9f50-75cc4e9ab496 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.803457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00340fc1-56c2-4997-862e-ab8bf972c537 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:11.812407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-00340fc1-56c2-4997-862e-ab8bf972c537 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1702 microversion: 2.1 time: 0.334231 Dec 15 16:24:11.813044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 262/510] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1702 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:11.818091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:11.819164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:11.825751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.826228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.827023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.827489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.988992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-12f15304-95f6-45f7-9f50-75cc4e9ab496 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:11.997810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-12f15304-95f6-45f7-9f50-75cc4e9ab496 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.353203 Dec 15 16:24:12.008111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 249/511] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:11 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:12.013656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fa5b5a59-2f4f-4bf7-9556-b8c871a0f500 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:12.020657 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa5b5a59-2f4f-4bf7-9556-b8c871a0f500 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.021520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa5b5a59-2f4f-4bf7-9556-b8c871a0f500 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.087874 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fa5b5a59-2f4f-4bf7-9556-b8c871a0f500 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Going to try to start instance {{(pid=116022) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 16:24:12.105117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:12.121843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:12.121843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:12.123536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8616775b-1dab-47ea-8edb-859f0d7e5b41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.309075 Dec 15 16:24:12.131562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 263/512] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:12.153418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fa5b5a59-2f4f-4bf7-9556-b8c871a0f500 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 202 len: 0 microversion: 2.1 time: 0.143274 Dec 15 16:24:12.154182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 250/513] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:24:12 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:24:12.163934 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-be679c02-0eaa-4b46-82e3-97a8ef2da279 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:12.164833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-be679c02-0eaa-4b46-82e3-97a8ef2da279 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:12.175181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-6ff9b50b-2bd1-4098-9219-3a4877224128 req-ee0d3127-325b-40ac-b470-b4ece8824fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9c05d20-8ed1-4779-aa4f-387c1aaf77ba", "tag": "08a212de-dfb7-49fd-9f5c-2214d2c64b2d"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:12.186075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:12.186075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:24:12.192743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be679c02-0eaa-4b46-82e3-97a8ef2da279 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.200872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be679c02-0eaa-4b46-82e3-97a8ef2da279 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.201793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be679c02-0eaa-4b46-82e3-97a8ef2da279 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.202210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be679c02-0eaa-4b46-82e3-97a8ef2da279 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.212635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-6ff9b50b-2bd1-4098-9219-3a4877224128 req-ee0d3127-325b-40ac-b470-b4ece8824fe7 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.216984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-6ff9b50b-2bd1-4098-9219-3a4877224128 req-ee0d3127-325b-40ac-b470-b4ece8824fe7 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.249317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-6ff9b50b-2bd1-4098-9219-3a4877224128 req-ee0d3127-325b-40ac-b470-b4ece8824fe7 service nova] Creating event network-changed:08a212de-dfb7-49fd-9f5c-2214d2c64b2d for instance a9c05d20-8ed1-4779-aa4f-387c1aaf77ba on hv-cinder-82002 Dec 15 16:24:12.261079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-6ff9b50b-2bd1-4098-9219-3a4877224128 req-ee0d3127-325b-40ac-b470-b4ece8824fe7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101305 Dec 15 16:24:12.262171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 264/514] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:12.499645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e7630102-630d-4233-9250-01681fe46f38 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:12.500486 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e7630102-630d-4233-9250-01681fe46f38 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:12.508121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7630102-630d-4233-9250-01681fe46f38 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.508989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7630102-630d-4233-9250-01681fe46f38 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.510055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7630102-630d-4233-9250-01681fe46f38 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.510715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7630102-630d-4233-9250-01681fe46f38 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.548273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-be679c02-0eaa-4b46-82e3-97a8ef2da279 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:12.560957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-be679c02-0eaa-4b46-82e3-97a8ef2da279 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1711 microversion: 2.1 time: 0.401132 Dec 15 16:24:12.562245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 251/515] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1711 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:12.679236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9827e763-93b1-4678-b5f8-0bd850ba3d15 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:12.680660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9827e763-93b1-4678-b5f8-0bd850ba3d15 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:12.690999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9827e763-93b1-4678-b5f8-0bd850ba3d15 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.691672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9827e763-93b1-4678-b5f8-0bd850ba3d15 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.692596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9827e763-93b1-4678-b5f8-0bd850ba3d15 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.693301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9827e763-93b1-4678-b5f8-0bd850ba3d15 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.912224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e7630102-630d-4233-9250-01681fe46f38 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:12.921727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e7630102-630d-4233-9250-01681fe46f38 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.428452 Dec 15 16:24:12.922359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 265/516] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:12 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:13.020333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b096f995-686b-4766-803e-100a500e29f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:13.023394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b096f995-686b-4766-803e-100a500e29f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:13.032988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b096f995-686b-4766-803e-100a500e29f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.033750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b096f995-686b-4766-803e-100a500e29f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.034873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b096f995-686b-4766-803e-100a500e29f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.035492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b096f995-686b-4766-803e-100a500e29f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.213832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9827e763-93b1-4678-b5f8-0bd850ba3d15 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:13.222981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9827e763-93b1-4678-b5f8-0bd850ba3d15 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1556 microversion: 2.1 time: 0.557844 Dec 15 16:24:13.223936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 252/517] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:12 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1556 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:13.229136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:13.230045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:13.236611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.237052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.237835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.238260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.424775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b096f995-686b-4766-803e-100a500e29f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:13.439903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b096f995-686b-4766-803e-100a500e29f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1258 microversion: 2.1 time: 0.427669 Dec 15 16:24:13.440831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 266/518] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1258 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:13.504901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:13.514911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:13.516526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:13.517743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-44dbd8a3-3ab8-490a-ab3b-eb54f93fda58 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.292854 Dec 15 16:24:13.518326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 253/519] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:13.579351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0672f8b8-a203-4a69-8862-a20b1b222362 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:13.580131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0672f8b8-a203-4a69-8862-a20b1b222362 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:13.587545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0672f8b8-a203-4a69-8862-a20b1b222362 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.587870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0672f8b8-a203-4a69-8862-a20b1b222362 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.588713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0672f8b8-a203-4a69-8862-a20b1b222362 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.589150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0672f8b8-a203-4a69-8862-a20b1b222362 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.895005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0672f8b8-a203-4a69-8862-a20b1b222362 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:13.903233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0672f8b8-a203-4a69-8862-a20b1b222362 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1711 microversion: 2.1 time: 0.327588 Dec 15 16:24:13.903821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 267/520] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:13 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1711 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:13.947450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a7764602-cbe6-4132-8bd4-ca6180be68bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:13.948061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a7764602-cbe6-4132-8bd4-ca6180be68bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:13.954661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a7764602-cbe6-4132-8bd4-ca6180be68bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.955101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a7764602-cbe6-4132-8bd4-ca6180be68bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.955919 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a7764602-cbe6-4132-8bd4-ca6180be68bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.956310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a7764602-cbe6-4132-8bd4-ca6180be68bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.186275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a7764602-cbe6-4132-8bd4-ca6180be68bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.200083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a7764602-cbe6-4132-8bd4-ca6180be68bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.256119 Dec 15 16:24:14.201181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 254/521] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:13 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:14.243110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fcaae7ed-782f-4948-aad7-44b0f4d19d58 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:14.244212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fcaae7ed-782f-4948-aad7-44b0f4d19d58 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:14.254819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcaae7ed-782f-4948-aad7-44b0f4d19d58 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.255546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcaae7ed-782f-4948-aad7-44b0f4d19d58 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.257190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcaae7ed-782f-4948-aad7-44b0f4d19d58 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.257955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcaae7ed-782f-4948-aad7-44b0f4d19d58 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.445507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fcaae7ed-782f-4948-aad7-44b0f4d19d58 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.455221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fcaae7ed-782f-4948-aad7-44b0f4d19d58 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1562 microversion: 2.1 time: 0.217615 Dec 15 16:24:14.456004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 268/522] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:14 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1562 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:14.462269 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-68b1fcaf-f91f-4821-959b-af2eaa207d47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:14.464389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-68b1fcaf-f91f-4821-959b-af2eaa207d47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:14.476552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68b1fcaf-f91f-4821-959b-af2eaa207d47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.476990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68b1fcaf-f91f-4821-959b-af2eaa207d47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.478097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68b1fcaf-f91f-4821-959b-af2eaa207d47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.478534 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68b1fcaf-f91f-4821-959b-af2eaa207d47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.537170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:14.537809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:14.544234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.545035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.545790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.546222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.742825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-68b1fcaf-f91f-4821-959b-af2eaa207d47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.750658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-68b1fcaf-f91f-4821-959b-af2eaa207d47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1442 microversion: 2.1 time: 0.295765 Dec 15 16:24:14.751279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 255/523] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1442 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:14.756059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e838247f-e13d-4329-9c59-577dba28c78a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:14.756571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e838247f-e13d-4329-9c59-577dba28c78a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:14.763091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e838247f-e13d-4329-9c59-577dba28c78a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.763472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e838247f-e13d-4329-9c59-577dba28c78a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.764299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e838247f-e13d-4329-9c59-577dba28c78a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.764766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e838247f-e13d-4329-9c59-577dba28c78a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.800058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.812854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.814353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.815593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8bb04364-2ce2-41c3-b4f8-70fc8cfa3779 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.283049 Dec 15 16:24:14.816356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 269/524] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:24:14.821862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-523e9ce2-9e74-4a77-b97a-c0aec4059a27 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:14.822767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-523e9ce2-9e74-4a77-b97a-c0aec4059a27 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:14.828960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-523e9ce2-9e74-4a77-b97a-c0aec4059a27 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.829404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-523e9ce2-9e74-4a77-b97a-c0aec4059a27 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.830202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-523e9ce2-9e74-4a77-b97a-c0aec4059a27 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.830641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-523e9ce2-9e74-4a77-b97a-c0aec4059a27 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.852619 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-e838247f-e13d-4329-9c59-577dba28c78a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lazy-loading 'services' on Instance uuid 7177930d-42eb-410e-a836-4287e9d78300 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:14.992383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-523e9ce2-9e74-4a77-b97a-c0aec4059a27 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.998701 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e838247f-e13d-4329-9c59-577dba28c78a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments/31455c68-75e7-4fff-a12c-6edf1cacfb44" status: 202 len: 0 microversion: 2.1 time: 0.245646 Dec 15 16:24:15.006869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 256/525] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Dec 15 16:24:14 2021] DELETE /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments/31455c68-75e7-4fff-a12c-6edf1cacfb44 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:24:15.007197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-523e9ce2-9e74-4a77-b97a-c0aec4059a27 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1442 microversion: 2.1 time: 0.187091 Dec 15 16:24:15.008129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 270/526] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1442 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:15.013212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c902ed19-3e52-48d9-bf2f-23ee120f8e40 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:15.014229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c902ed19-3e52-48d9-bf2f-23ee120f8e40 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:15.019389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0e12468d-1da7-417f-b23f-1aa0ddf24a59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:15.020758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0e12468d-1da7-417f-b23f-1aa0ddf24a59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:15.028397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c902ed19-3e52-48d9-bf2f-23ee120f8e40 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.029507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c902ed19-3e52-48d9-bf2f-23ee120f8e40 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.031151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c902ed19-3e52-48d9-bf2f-23ee120f8e40 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.032182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c902ed19-3e52-48d9-bf2f-23ee120f8e40 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.041265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e12468d-1da7-417f-b23f-1aa0ddf24a59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.042093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e12468d-1da7-417f-b23f-1aa0ddf24a59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.044361 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e12468d-1da7-417f-b23f-1aa0ddf24a59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.045755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e12468d-1da7-417f-b23f-1aa0ddf24a59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.103241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c902ed19-3e52-48d9-bf2f-23ee120f8e40 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093815 Dec 15 16:24:15.104620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 271/527] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:15 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:15.223573 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5463c913-c199-40a0-84d5-c5f908abd6b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:15.224644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5463c913-c199-40a0-84d5-c5f908abd6b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:15.234744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5463c913-c199-40a0-84d5-c5f908abd6b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.235419 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5463c913-c199-40a0-84d5-c5f908abd6b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.236333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5463c913-c199-40a0-84d5-c5f908abd6b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.236898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5463c913-c199-40a0-84d5-c5f908abd6b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.279090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0e12468d-1da7-417f-b23f-1aa0ddf24a59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:15.293453 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0e12468d-1da7-417f-b23f-1aa0ddf24a59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1715 microversion: 2.1 time: 0.289797 Dec 15 16:24:15.294495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 257/528] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1715 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:15.396117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5463c913-c199-40a0-84d5-c5f908abd6b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:15.403846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5463c913-c199-40a0-84d5-c5f908abd6b9 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.186583 Dec 15 16:24:15.407544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 272/529] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:15 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:15.834965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:15.835774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:15.842389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.842996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.843922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.844220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.999036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:16.008994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:16.010524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:16.011761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3c936293-104b-411a-9962-00e100182e98 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.180977 Dec 15 16:24:16.012320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 258/530] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:16.118584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bed4f3e5-9f78-4974-9b9b-94080543a70f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:16.119954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bed4f3e5-9f78-4974-9b9b-94080543a70f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:16.127858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bed4f3e5-9f78-4974-9b9b-94080543a70f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.128383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bed4f3e5-9f78-4974-9b9b-94080543a70f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.129125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bed4f3e5-9f78-4974-9b9b-94080543a70f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.129553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bed4f3e5-9f78-4974-9b9b-94080543a70f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.161185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bed4f3e5-9f78-4974-9b9b-94080543a70f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Dec 15 16:24:16.162103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 273/531] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:16 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:16.423139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-291c363e-c05a-46d4-bf8c-9ab5a8f2a158 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:16.423139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-291c363e-c05a-46d4-bf8c-9ab5a8f2a158 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:16.430712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-291c363e-c05a-46d4-bf8c-9ab5a8f2a158 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.431167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-291c363e-c05a-46d4-bf8c-9ab5a8f2a158 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.432189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-291c363e-c05a-46d4-bf8c-9ab5a8f2a158 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.432661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-291c363e-c05a-46d4-bf8c-9ab5a8f2a158 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.577529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-291c363e-c05a-46d4-bf8c-9ab5a8f2a158 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:16.586211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-291c363e-c05a-46d4-bf8c-9ab5a8f2a158 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.167728 Dec 15 16:24:16.592574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 259/532] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:16 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:17.034083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:17.035245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:17.047398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.048195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.049675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.050455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.175208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d81c7eb4-db4a-4495-a972-a18dd8affe7f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:17.178198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d81c7eb4-db4a-4495-a972-a18dd8affe7f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:17.191732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d81c7eb4-db4a-4495-a972-a18dd8affe7f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.192987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d81c7eb4-db4a-4495-a972-a18dd8affe7f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.194315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d81c7eb4-db4a-4495-a972-a18dd8affe7f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.194950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d81c7eb4-db4a-4495-a972-a18dd8affe7f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.207978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:17.216779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:17.218354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:17.219705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bc1d855a-a2fc-40c9-880b-c437b70cf5d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.192561 Dec 15 16:24:17.220619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 274/533] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:17.229979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d81c7eb4-db4a-4495-a972-a18dd8affe7f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060629 Dec 15 16:24:17.232917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 260/534] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:17 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:17.420144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-c7b96859-163d-4e5e-bb88-ab389c345894 req-a85e1f14-8012-4986-82c6-5766e9f403a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4fd848-09ba-42aa-9176-dc8a60b95be2", "tag": "2c61efe0-6ed5-4b49-8a66-8e9f491633d4"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:17.421681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:17.421681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:24:17.429492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-c7b96859-163d-4e5e-bb88-ab389c345894 req-a85e1f14-8012-4986-82c6-5766e9f403a1 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.430270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-c7b96859-163d-4e5e-bb88-ab389c345894 req-a85e1f14-8012-4986-82c6-5766e9f403a1 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.442583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-c7b96859-163d-4e5e-bb88-ab389c345894 req-a85e1f14-8012-4986-82c6-5766e9f403a1 service nova] Creating event network-changed:2c61efe0-6ed5-4b49-8a66-8e9f491633d4 for instance 4c4fd848-09ba-42aa-9176-dc8a60b95be2 on hv-cinder-82002 Dec 15 16:24:17.448181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-c7b96859-163d-4e5e-bb88-ab389c345894 req-a85e1f14-8012-4986-82c6-5766e9f403a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031608 Dec 15 16:24:17.449840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 275/535] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:17.607651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1bf676da-803c-4d66-a8d1-440e346198bc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:17.608740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1bf676da-803c-4d66-a8d1-440e346198bc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:17.625435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1bf676da-803c-4d66-a8d1-440e346198bc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.625835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1bf676da-803c-4d66-a8d1-440e346198bc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.626836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1bf676da-803c-4d66-a8d1-440e346198bc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.627440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1bf676da-803c-4d66-a8d1-440e346198bc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.855655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1bf676da-803c-4d66-a8d1-440e346198bc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:17.871006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1bf676da-803c-4d66-a8d1-440e346198bc tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.270747 Dec 15 16:24:17.884692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 261/536] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:17 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:18.241869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:18.243715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1f9b94c8-6114-44f3-9161-e69e8ea719c2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:18.244372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:18.244678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1f9b94c8-6114-44f3-9161-e69e8ea719c2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:18.252972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:18.253797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:18.254670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:18.254803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f9b94c8-6114-44f3-9161-e69e8ea719c2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:18.255202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f9b94c8-6114-44f3-9161-e69e8ea719c2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:18.255587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:18.256284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f9b94c8-6114-44f3-9161-e69e8ea719c2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:18.257017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f9b94c8-6114-44f3-9161-e69e8ea719c2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:18.315903 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1f9b94c8-6114-44f3-9161-e69e8ea719c2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077093 Dec 15 16:24:18.324016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 262/537] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:18 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:18.424598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:18.433955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:18.435495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:18.436761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c522229a-fd27-44cc-9df3-b9e572a31458 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.199267 Dec 15 16:24:18.437337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 276/538] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:18.891476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-177a340f-a15f-4fba-a737-b74fd0a0a771 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:18.892403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-177a340f-a15f-4fba-a737-b74fd0a0a771 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:18.900306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-177a340f-a15f-4fba-a737-b74fd0a0a771 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:18.901082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-177a340f-a15f-4fba-a737-b74fd0a0a771 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:18.901857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-177a340f-a15f-4fba-a737-b74fd0a0a771 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:18.902337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-177a340f-a15f-4fba-a737-b74fd0a0a771 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.309606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-177a340f-a15f-4fba-a737-b74fd0a0a771 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:19.317386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-177a340f-a15f-4fba-a737-b74fd0a0a771 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.429839 Dec 15 16:24:19.317961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 263/539] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:18 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:19.333188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eebc15a0-fdec-4f09-aade-f7aa8a2db151 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:19.334625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eebc15a0-fdec-4f09-aade-f7aa8a2db151 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:19.344000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eebc15a0-fdec-4f09-aade-f7aa8a2db151 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.344712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eebc15a0-fdec-4f09-aade-f7aa8a2db151 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.345916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eebc15a0-fdec-4f09-aade-f7aa8a2db151 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.346581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eebc15a0-fdec-4f09-aade-f7aa8a2db151 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.380505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eebc15a0-fdec-4f09-aade-f7aa8a2db151 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054070 Dec 15 16:24:19.380998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 277/540] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:19 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:19.458989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:19.459974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:19.468970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.469545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.470682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.471165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.619304 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:19.631782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:19.634168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:19.635731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3d3f32b4-c76b-41c4-bbc0-a02bd2fed08a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.182542 Dec 15 16:24:19.636476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 264/541] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:20.337568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-16afe2cd-79e1-4897-8f56-9683c8a15df1 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:20.338704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-16afe2cd-79e1-4897-8f56-9683c8a15df1 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:20.345621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-16afe2cd-79e1-4897-8f56-9683c8a15df1 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.346458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-16afe2cd-79e1-4897-8f56-9683c8a15df1 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.347101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-16afe2cd-79e1-4897-8f56-9683c8a15df1 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.347555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-16afe2cd-79e1-4897-8f56-9683c8a15df1 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.392902 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-697d1045-fb71-4a56-91ac-0e1076659f70 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:20.393840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-697d1045-fb71-4a56-91ac-0e1076659f70 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:20.402492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-697d1045-fb71-4a56-91ac-0e1076659f70 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.402492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-697d1045-fb71-4a56-91ac-0e1076659f70 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.402492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-697d1045-fb71-4a56-91ac-0e1076659f70 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.405383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-697d1045-fb71-4a56-91ac-0e1076659f70 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.439301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-697d1045-fb71-4a56-91ac-0e1076659f70 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050085 Dec 15 16:24:20.440212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 265/542] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:20 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:24:20.521802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-16afe2cd-79e1-4897-8f56-9683c8a15df1 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:20.530151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-16afe2cd-79e1-4897-8f56-9683c8a15df1 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.198071 Dec 15 16:24:20.536575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 278/543] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:20 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:20.656945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:20.657561 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:20.664387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.664878 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.665686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.666127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.742738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-23c36bca-026f-430d-888c-4d37d3965321 req-665a68ea-f4ef-4bd9-89ed-a4caa8221788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c05d20-8ed1-4779-aa4f-387c1aaf77ba", "name": "network-vif-plugged", "status": "completed", "tag": "08a212de-dfb7-49fd-9f5c-2214d2c64b2d"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:20.744826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:20.744826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:24:20.754277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-23c36bca-026f-430d-888c-4d37d3965321 req-665a68ea-f4ef-4bd9-89ed-a4caa8221788 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.754885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-23c36bca-026f-430d-888c-4d37d3965321 req-665a68ea-f4ef-4bd9-89ed-a4caa8221788 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.768766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-23c36bca-026f-430d-888c-4d37d3965321 req-665a68ea-f4ef-4bd9-89ed-a4caa8221788 service nova] Creating event network-vif-plugged:08a212de-dfb7-49fd-9f5c-2214d2c64b2d for instance a9c05d20-8ed1-4779-aa4f-387c1aaf77ba on hv-cinder-82002 Dec 15 16:24:20.773769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-23c36bca-026f-430d-888c-4d37d3965321 req-665a68ea-f4ef-4bd9-89ed-a4caa8221788 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035587 Dec 15 16:24:20.774503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 279/544] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:20.802163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:20.810844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:20.812408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:20.813713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ba0d7e28-9666-4cc3-899c-124ea7779681 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.160775 Dec 15 16:24:20.814464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 266/545] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:21.548464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e56c1292-fd6d-437e-9c4b-ff23e7670c35 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:21.549160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e56c1292-fd6d-437e-9c4b-ff23e7670c35 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:21.556073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e56c1292-fd6d-437e-9c4b-ff23e7670c35 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:21.556548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e56c1292-fd6d-437e-9c4b-ff23e7670c35 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:21.557350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e56c1292-fd6d-437e-9c4b-ff23e7670c35 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:21.557778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e56c1292-fd6d-437e-9c4b-ff23e7670c35 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:21.705011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e56c1292-fd6d-437e-9c4b-ff23e7670c35 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:21.713333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e56c1292-fd6d-437e-9c4b-ff23e7670c35 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.169287 Dec 15 16:24:21.713934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 280/546] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:21 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:21.834306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:21.835163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:21.842067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:21.842510 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:21.843408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:21.843838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:21.986324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:21.995908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:21.997421 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:21.998611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-11042aa9-ebf7-42eb-83d6-874344e20410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.168096 Dec 15 16:24:21.999184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 267/547] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:22.731049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-117ce632-2a65-4dba-9af4-0f207e8c03a7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:22.731677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-117ce632-2a65-4dba-9af4-0f207e8c03a7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:22.739528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-117ce632-2a65-4dba-9af4-0f207e8c03a7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.740143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-117ce632-2a65-4dba-9af4-0f207e8c03a7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.741256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-117ce632-2a65-4dba-9af4-0f207e8c03a7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.741821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-117ce632-2a65-4dba-9af4-0f207e8c03a7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.901353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-117ce632-2a65-4dba-9af4-0f207e8c03a7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:22.909232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-117ce632-2a65-4dba-9af4-0f207e8c03a7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.181904 Dec 15 16:24:22.909831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 281/548] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:22 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:23.019403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:23.019969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:23.027293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:23.027795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:23.028854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:23.029334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:23.184287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:23.192925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:23.194439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:23.195755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a458500d-9a2a-4f73-9b51-50dfd1a0f0cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.180282 Dec 15 16:24:23.196316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 268/549] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:23.932536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-613475ab-0a88-46c1-8f22-5cb3b5dee77d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:23.933386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-613475ab-0a88-46c1-8f22-5cb3b5dee77d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:23.941048 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-613475ab-0a88-46c1-8f22-5cb3b5dee77d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:23.941503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-613475ab-0a88-46c1-8f22-5cb3b5dee77d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:23.942319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-613475ab-0a88-46c1-8f22-5cb3b5dee77d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:23.942753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-613475ab-0a88-46c1-8f22-5cb3b5dee77d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:24.083880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-613475ab-0a88-46c1-8f22-5cb3b5dee77d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:24.094064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-613475ab-0a88-46c1-8f22-5cb3b5dee77d tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.169553 Dec 15 16:24:24.095229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 282/550] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:23 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:24.214840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:24.215506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:24.222676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:24.223099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:24.223910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:24.224337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:24.374736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:24.383370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:24.384884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:24.386084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1a8952d0-28ef-4e05-82f1-cab6dc4e3da2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.175643 Dec 15 16:24:24.386638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 269/551] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:25.111597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d503d650-8498-4a54-860f-d758ff6ed1c2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:25.112214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d503d650-8498-4a54-860f-d758ff6ed1c2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:25.120582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d503d650-8498-4a54-860f-d758ff6ed1c2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.121551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d503d650-8498-4a54-860f-d758ff6ed1c2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.123039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d503d650-8498-4a54-860f-d758ff6ed1c2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.124043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d503d650-8498-4a54-860f-d758ff6ed1c2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.276078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d503d650-8498-4a54-860f-d758ff6ed1c2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:25.287507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d503d650-8498-4a54-860f-d758ff6ed1c2 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.179213 Dec 15 16:24:25.288929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 283/552] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:25 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:25.404527 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:25.405335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:25.412266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.412773 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.413578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.414013 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.556343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:25.570135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:25.570135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:25.570135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c9e207d0-780a-4308-b011-4d177b4945a3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.168509 Dec 15 16:24:25.570598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 270/553] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:26.310129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e2efda2a-7a66-4b7c-91ed-9f8a940a4909 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:26.310778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e2efda2a-7a66-4b7c-91ed-9f8a940a4909 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:26.318237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2efda2a-7a66-4b7c-91ed-9f8a940a4909 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.318688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2efda2a-7a66-4b7c-91ed-9f8a940a4909 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.319490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2efda2a-7a66-4b7c-91ed-9f8a940a4909 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.319927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2efda2a-7a66-4b7c-91ed-9f8a940a4909 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.475298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e2efda2a-7a66-4b7c-91ed-9f8a940a4909 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:26.483148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e2efda2a-7a66-4b7c-91ed-9f8a940a4909 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.178601 Dec 15 16:24:26.483761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 284/554] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:26 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:26.588883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:26.589513 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:26.596840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.597281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.598195 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.598626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.745158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:26.754435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:26.755926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:26.757198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-08745af2-f8a3-4ba9-8c16-2db9414a12d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.172213 Dec 15 16:24:26.757796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 271/555] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:24:27.500712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-067bd296-008a-44da-8687-4cb883b3219a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:27.501561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-067bd296-008a-44da-8687-4cb883b3219a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:27.511303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-067bd296-008a-44da-8687-4cb883b3219a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.511851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-067bd296-008a-44da-8687-4cb883b3219a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.512759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-067bd296-008a-44da-8687-4cb883b3219a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.513357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-067bd296-008a-44da-8687-4cb883b3219a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.673363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-067bd296-008a-44da-8687-4cb883b3219a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:27.682149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-067bd296-008a-44da-8687-4cb883b3219a tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.185165 Dec 15 16:24:27.682724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 285/556] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:27 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:27.777205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:27.778289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:27.785508 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.785928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.786824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.787262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.932249 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:27.941481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:27.942974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:27.944293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5372e792-9a20-4677-bf6b-6510d25c1eaf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.171111 Dec 15 16:24:27.944906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 272/557] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:28.702604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-43f81b38-9f7e-4603-97a6-2ca7d9d7fdb7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:28.703222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-43f81b38-9f7e-4603-97a6-2ca7d9d7fdb7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:28.712119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43f81b38-9f7e-4603-97a6-2ca7d9d7fdb7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:28.713244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43f81b38-9f7e-4603-97a6-2ca7d9d7fdb7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:28.714226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43f81b38-9f7e-4603-97a6-2ca7d9d7fdb7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:28.714687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43f81b38-9f7e-4603-97a6-2ca7d9d7fdb7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:28.866891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-43f81b38-9f7e-4603-97a6-2ca7d9d7fdb7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:28.875235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-43f81b38-9f7e-4603-97a6-2ca7d9d7fdb7 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.178890 Dec 15 16:24:28.875813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 286/558] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:28 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:28.964040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:28.964724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:28.971603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:28.972117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:28.973015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:28.973445 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:29.121465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:29.130480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:29.131959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:29.133163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7521857e-afbf-4f95-83fe-6f792d6e5c79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.173536 Dec 15 16:24:29.133724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 273/559] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:29.895284 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a3f4dbd5-eda0-44c7-8c17-6776567181e3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:29.896233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a3f4dbd5-eda0-44c7-8c17-6776567181e3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:29.905762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3f4dbd5-eda0-44c7-8c17-6776567181e3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:29.906209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3f4dbd5-eda0-44c7-8c17-6776567181e3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:29.908130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3f4dbd5-eda0-44c7-8c17-6776567181e3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:29.908669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3f4dbd5-eda0-44c7-8c17-6776567181e3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:30.107077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a3f4dbd5-eda0-44c7-8c17-6776567181e3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:30.117751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a3f4dbd5-eda0-44c7-8c17-6776567181e3 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1314 microversion: 2.1 time: 0.227633 Dec 15 16:24:30.119158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 287/560] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:29 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:30.152757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:30.153379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:30.161394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:30.161857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:30.163229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:30.163489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:30.340170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:30.352175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:30.354833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:30.356161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-af3fe54f-1f3e-4160-8ce3-ad402a1eb66b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.208490 Dec 15 16:24:30.356799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 274/561] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:31.144351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-241c4bf8-70cb-4993-9f99-b01c1f7adfdf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:31.145027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-241c4bf8-70cb-4993-9f99-b01c1f7adfdf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:31.152132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-241c4bf8-70cb-4993-9f99-b01c1f7adfdf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.152626 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-241c4bf8-70cb-4993-9f99-b01c1f7adfdf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.153428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-241c4bf8-70cb-4993-9f99-b01c1f7adfdf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.153861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-241c4bf8-70cb-4993-9f99-b01c1f7adfdf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.212864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bd8623a4-1b16-4e98-8720-3139c81f8799 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:31.213694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bd8623a4-1b16-4e98-8720-3139c81f8799 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:31.220532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd8623a4-1b16-4e98-8720-3139c81f8799 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.220982 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd8623a4-1b16-4e98-8720-3139c81f8799 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.221911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd8623a4-1b16-4e98-8720-3139c81f8799 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.222214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd8623a4-1b16-4e98-8720-3139c81f8799 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.249019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bd8623a4-1b16-4e98-8720-3139c81f8799 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Going to try to terminate instance {{(pid=116022) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:31.306492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-241c4bf8-70cb-4993-9f99-b01c1f7adfdf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:31.319606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-241c4bf8-70cb-4993-9f99-b01c1f7adfdf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1497 microversion: 2.1 time: 0.178596 Dec 15 16:24:31.320714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 288/562] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:31 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:31.350197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bd8623a4-1b16-4e98-8720-3139c81f8799 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 204 len: 0 microversion: 2.1 time: 0.137697 Dec 15 16:24:31.350197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 275/563] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:31 2021] DELETE /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:24:31.356678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2b9fab9f-dfbb-4bdc-883a-88e9ca7ce2b2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:31.357385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2b9fab9f-dfbb-4bdc-883a-88e9ca7ce2b2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:31.364337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b9fab9f-dfbb-4bdc-883a-88e9ca7ce2b2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.364752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b9fab9f-dfbb-4bdc-883a-88e9ca7ce2b2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.365569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b9fab9f-dfbb-4bdc-883a-88e9ca7ce2b2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.365993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b9fab9f-dfbb-4bdc-883a-88e9ca7ce2b2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.388873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:31.390232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:31.401526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.402408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.403871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.404738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.565056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2b9fab9f-dfbb-4bdc-883a-88e9ca7ce2b2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:31.577816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2b9fab9f-dfbb-4bdc-883a-88e9ca7ce2b2 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.224854 Dec 15 16:24:31.578880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 289/564] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:31 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:31.612871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:31.623764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:31.626013 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:31.627261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-093f8d0b-7930-4bb7-8a34-93596af5c55f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.247261 Dec 15 16:24:31.627842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 276/565] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:32.596857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-028ef0e3-b6cc-4af7-af06-62988370cfbf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:32.597528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-028ef0e3-b6cc-4af7-af06-62988370cfbf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:32.604786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-028ef0e3-b6cc-4af7-af06-62988370cfbf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:32.605233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-028ef0e3-b6cc-4af7-af06-62988370cfbf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:32.606038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-028ef0e3-b6cc-4af7-af06-62988370cfbf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:32.606463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-028ef0e3-b6cc-4af7-af06-62988370cfbf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:32.654159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:32.655000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:32.661915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:32.662361 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:32.663187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:32.663616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:32.847828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-028ef0e3-b6cc-4af7-af06-62988370cfbf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:32.858948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-028ef0e3-b6cc-4af7-af06-62988370cfbf tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.265518 Dec 15 16:24:32.860128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 290/566] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:32 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:32.890882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:32.900525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:32.902190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:32.903436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d2bfb549-cd1a-4cad-a831-018e30d8257a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.253426 Dec 15 16:24:32.904303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 277/567] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:32.923508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-eafc9ad4-72db-4627-9d2e-5c51fd97fa2b req-b473642b-49a0-40c6-933c-f8296750bdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134cc886-afce-4a89-b875-cdf6768bfd8f", "name": "network-vif-plugged", "status": "completed", "tag": "9b8f6012-13ef-4292-8d62-47854410ace5"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:32.925168 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:32.925168 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:24:32.932854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-eafc9ad4-72db-4627-9d2e-5c51fd97fa2b req-b473642b-49a0-40c6-933c-f8296750bdc2 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:32.933406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-eafc9ad4-72db-4627-9d2e-5c51fd97fa2b req-b473642b-49a0-40c6-933c-f8296750bdc2 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:32.944948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-eafc9ad4-72db-4627-9d2e-5c51fd97fa2b req-b473642b-49a0-40c6-933c-f8296750bdc2 service nova] Creating event network-vif-plugged:9b8f6012-13ef-4292-8d62-47854410ace5 for instance 134cc886-afce-4a89-b875-cdf6768bfd8f on hv-cinder-82002 Dec 15 16:24:32.950238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-eafc9ad4-72db-4627-9d2e-5c51fd97fa2b req-b473642b-49a0-40c6-933c-f8296750bdc2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030366 Dec 15 16:24:32.950839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 291/568] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:33.876207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cad036dc-2458-4fbf-9aed-3c222c95504b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:33.876875 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cad036dc-2458-4fbf-9aed-3c222c95504b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:33.884311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cad036dc-2458-4fbf-9aed-3c222c95504b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:33.884311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cad036dc-2458-4fbf-9aed-3c222c95504b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:33.885464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cad036dc-2458-4fbf-9aed-3c222c95504b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:33.885878 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cad036dc-2458-4fbf-9aed-3c222c95504b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:33.923021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:33.924399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:33.932770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:33.933407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:33.934414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:33.934970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:34.077027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cad036dc-2458-4fbf-9aed-3c222c95504b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:34.085777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cad036dc-2458-4fbf-9aed-3c222c95504b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.213263 Dec 15 16:24:34.086382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 278/569] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:33 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:34.138747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:34.151196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:34.152728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:34.153974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a394f2e4-7b1a-4eb3-800e-ddc8ed1f3a86 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.235678 Dec 15 16:24:34.154618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 292/570] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:24:35.111135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d5ae3191-a8bb-4ed1-bf75-9320a23f51aa tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:35.111725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d5ae3191-a8bb-4ed1-bf75-9320a23f51aa tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:35.118876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5ae3191-a8bb-4ed1-bf75-9320a23f51aa tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:35.119330 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5ae3191-a8bb-4ed1-bf75-9320a23f51aa tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:35.120153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5ae3191-a8bb-4ed1-bf75-9320a23f51aa tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:35.120849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5ae3191-a8bb-4ed1-bf75-9320a23f51aa tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:35.176031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:35.177124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:35.185575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:35.186428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:35.187839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:35.188489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:35.328179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d5ae3191-a8bb-4ed1-bf75-9320a23f51aa tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:35.336916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d5ae3191-a8bb-4ed1-bf75-9320a23f51aa tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.229989 Dec 15 16:24:35.337757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 279/571] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:35 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:35.385831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:35.395244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:35.396785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:35.397997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-488ee23e-0aff-425b-ada9-ab17c02d1da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.226172 Dec 15 16:24:35.398565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 293/572] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:24:36.319134 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3ed70d80-a79b-466b-b2e8-a884aaa17b2f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:36.319735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3ed70d80-a79b-466b-b2e8-a884aaa17b2f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:36.327428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ed70d80-a79b-466b-b2e8-a884aaa17b2f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.328080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ed70d80-a79b-466b-b2e8-a884aaa17b2f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.329532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ed70d80-a79b-466b-b2e8-a884aaa17b2f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.330400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ed70d80-a79b-466b-b2e8-a884aaa17b2f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.362762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-99b6b6d9-df10-47dd-af4a-f67d7a33c3a3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:36.363558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-99b6b6d9-df10-47dd-af4a-f67d7a33c3a3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:36.365379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3ed70d80-a79b-466b-b2e8-a884aaa17b2f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Going to try to terminate instance {{(pid=116022) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:36.371504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b6b6d9-df10-47dd-af4a-f67d7a33c3a3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.371948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b6b6d9-df10-47dd-af4a-f67d7a33c3a3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.372866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b6b6d9-df10-47dd-af4a-f67d7a33c3a3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.373397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b6b6d9-df10-47dd-af4a-f67d7a33c3a3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.467114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3ed70d80-a79b-466b-b2e8-a884aaa17b2f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 204 len: 0 microversion: 2.1 time: 0.150725 Dec 15 16:24:36.469051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 280/573] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:36 2021] DELETE /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:24:36.480156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:36.481541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:36.491723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.492563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.494182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.495003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.595129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-99b6b6d9-df10-47dd-af4a-f67d7a33c3a3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:36.603186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-99b6b6d9-df10-47dd-af4a-f67d7a33c3a3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.244767 Dec 15 16:24:36.603788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 294/574] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:36 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:36.609480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2358d5c0-3c1f-42fb-b72f-f235b78ea2bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:36.611615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2358d5c0-3c1f-42fb-b72f-f235b78ea2bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:36.616719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2358d5c0-3c1f-42fb-b72f-f235b78ea2bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.617160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2358d5c0-3c1f-42fb-b72f-f235b78ea2bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.618195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2358d5c0-3c1f-42fb-b72f-f235b78ea2bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.619023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2358d5c0-3c1f-42fb-b72f-f235b78ea2bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.723317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:36.733149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:36.735211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:36.736329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6a43d013-4c26-4c9d-81b5-1012500c06ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.265609 Dec 15 16:24:36.737219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 281/575] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:36.797087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2358d5c0-3c1f-42fb-b72f-f235b78ea2bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:36.805152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2358d5c0-3c1f-42fb-b72f-f235b78ea2bf tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1503 microversion: 2.1 time: 0.199890 Dec 15 16:24:36.805749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 295/576] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:36 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:37.634007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-58d18e80-0460-4e47-8563-387542ec9107 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:37.635289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-58d18e80-0460-4e47-8563-387542ec9107 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:37.646298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-58d18e80-0460-4e47-8563-387542ec9107 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:37.646960 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-58d18e80-0460-4e47-8563-387542ec9107 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:37.648309 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-58d18e80-0460-4e47-8563-387542ec9107 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:37.649043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-58d18e80-0460-4e47-8563-387542ec9107 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:37.755779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:37.756664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:37.763698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:37.764234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:37.765734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:37.765734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:37.845722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-58d18e80-0460-4e47-8563-387542ec9107 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:37.855477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-58d18e80-0460-4e47-8563-387542ec9107 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.227331 Dec 15 16:24:37.866265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 282/577] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:37 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:37.866265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eb462be3-fdcd-435b-a27b-4b64cb8199e8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:37.866265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eb462be3-fdcd-435b-a27b-4b64cb8199e8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:37.869155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb462be3-fdcd-435b-a27b-4b64cb8199e8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:37.869604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb462be3-fdcd-435b-a27b-4b64cb8199e8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:37.870419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb462be3-fdcd-435b-a27b-4b64cb8199e8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:37.870856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb462be3-fdcd-435b-a27b-4b64cb8199e8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:37.944014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:37.953698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:37.955236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:37.956501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-522ac73c-e9cd-4d00-98b1-efb458d7d9c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.205061 Dec 15 16:24:37.957085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 296/578] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:38.045927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eb462be3-fdcd-435b-a27b-4b64cb8199e8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:38.055056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eb462be3-fdcd-435b-a27b-4b64cb8199e8 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1503 microversion: 2.1 time: 0.197635 Dec 15 16:24:38.055641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 283/579] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:37 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:38.873911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ba794bfa-a118-49a9-bea4-188fd353a777 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:38.874548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ba794bfa-a118-49a9-bea4-188fd353a777 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:38.881373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba794bfa-a118-49a9-bea4-188fd353a777 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:38.881825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba794bfa-a118-49a9-bea4-188fd353a777 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:38.882630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba794bfa-a118-49a9-bea4-188fd353a777 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:38.883043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba794bfa-a118-49a9-bea4-188fd353a777 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:38.976785 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:38.977416 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:38.985437 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:38.985886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:38.986692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:38.987126 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:39.040150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ba794bfa-a118-49a9-bea4-188fd353a777 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:39.048641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ba794bfa-a118-49a9-bea4-188fd353a777 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.178318 Dec 15 16:24:39.050431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 297/580] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:38 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:39.072698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-797e48e2-6436-4a16-bf35-a7a099c086f0 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:39.073324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-797e48e2-6436-4a16-bf35-a7a099c086f0 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:39.079613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-797e48e2-6436-4a16-bf35-a7a099c086f0 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:39.080062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-797e48e2-6436-4a16-bf35-a7a099c086f0 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:39.080882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-797e48e2-6436-4a16-bf35-a7a099c086f0 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:39.081309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-797e48e2-6436-4a16-bf35-a7a099c086f0 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:39.149280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:39.159140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:39.160704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:39.161927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-abbe397a-c331-4c01-9cf5-d4a659215944 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1808 microversion: 2.20 time: 0.188841 Dec 15 16:24:39.162931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 284/581] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:39.287455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-797e48e2-6436-4a16-bf35-a7a099c086f0 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:39.296549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-797e48e2-6436-4a16-bf35-a7a099c086f0 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1503 microversion: 2.1 time: 0.227638 Dec 15 16:24:39.297244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 298/582] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:39 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:40.066319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-362ca29a-4bef-4985-a9dd-f449b7a87e71 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:40.067064 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-362ca29a-4bef-4985-a9dd-f449b7a87e71 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:40.074267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-362ca29a-4bef-4985-a9dd-f449b7a87e71 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.074724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-362ca29a-4bef-4985-a9dd-f449b7a87e71 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.075544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-362ca29a-4bef-4985-a9dd-f449b7a87e71 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.075991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-362ca29a-4bef-4985-a9dd-f449b7a87e71 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.184329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:40.185179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:40.196463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.197355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.199107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.199863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.255671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-362ca29a-4bef-4985-a9dd-f449b7a87e71 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:40.264952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-362ca29a-4bef-4985-a9dd-f449b7a87e71 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.202328 Dec 15 16:24:40.272136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 285/583] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:40 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:40.282326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bf4dea17-8fd1-4936-92b5-59b05b188e32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:40.283280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bf4dea17-8fd1-4936-92b5-59b05b188e32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:40.294574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bf4dea17-8fd1-4936-92b5-59b05b188e32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.295180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bf4dea17-8fd1-4936-92b5-59b05b188e32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.296304 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bf4dea17-8fd1-4936-92b5-59b05b188e32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.297088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bf4dea17-8fd1-4936-92b5-59b05b188e32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.389900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-bf4dea17-8fd1-4936-92b5-59b05b188e32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lazy-loading 'services' on Instance uuid 02506a5c-6c61-442c-bedf-ffbe1dd23ff2 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:40.390708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:40.399577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:40.401386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:40.402591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0e445727-8c0d-438c-b89a-0c5642bd4ec9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1795 microversion: 2.20 time: 0.225604 Dec 15 16:24:40.403165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 299/584] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1795 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:24:40.407817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aa9cf4c0-c85b-48fc-875e-3f866431b988 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:40.408482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aa9cf4c0-c85b-48fc-875e-3f866431b988 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:40.414745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa9cf4c0-c85b-48fc-875e-3f866431b988 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.415190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa9cf4c0-c85b-48fc-875e-3f866431b988 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.416452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa9cf4c0-c85b-48fc-875e-3f866431b988 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.417054 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa9cf4c0-c85b-48fc-875e-3f866431b988 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.481121 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bf4dea17-8fd1-4936-92b5-59b05b188e32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2/os-volume_attachments/076e1b16-eab6-44c8-9856-755b75a5da30" status: 202 len: 0 microversion: 2.1 time: 0.206030 Dec 15 16:24:40.485568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 286/585] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Dec 15 16:24:40 2021] DELETE /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2/os-volume_attachments/076e1b16-eab6-44c8-9856-755b75a5da30 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:24:40.599740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-aa9cf4c0-c85b-48fc-875e-3f866431b988 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:40.608367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aa9cf4c0-c85b-48fc-875e-3f866431b988 tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1503 microversion: 2.1 time: 0.203948 Dec 15 16:24:40.608991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 300/586] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:40 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:41.243111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-7057807f-8104-4d80-bd60-50c7b556c7ed req-4075dea5-91a3-42e2-bcbe-6bb8326fcdfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c05d20-8ed1-4779-aa4f-387c1aaf77ba", "name": "network-vif-deleted", "tag": "08a212de-dfb7-49fd-9f5c-2214d2c64b2d"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:41.246614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:41.246614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:24:41.256349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-7057807f-8104-4d80-bd60-50c7b556c7ed req-4075dea5-91a3-42e2-bcbe-6bb8326fcdfb service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:41.257384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-7057807f-8104-4d80-bd60-50c7b556c7ed req-4075dea5-91a3-42e2-bcbe-6bb8326fcdfb service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:41.278348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-7057807f-8104-4d80-bd60-50c7b556c7ed req-4075dea5-91a3-42e2-bcbe-6bb8326fcdfb service nova] Creating event network-vif-deleted:08a212de-dfb7-49fd-9f5c-2214d2c64b2d for instance a9c05d20-8ed1-4779-aa4f-387c1aaf77ba on hv-cinder-82002 Dec 15 16:24:41.287424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-7057807f-8104-4d80-bd60-50c7b556c7ed req-4075dea5-91a3-42e2-bcbe-6bb8326fcdfb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053128 Dec 15 16:24:41.288102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-86be8f9e-9b71-4324-ba91-c2bf925a6ecc tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:41.289089 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 287/587] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:41.300665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-86be8f9e-9b71-4324-ba91-c2bf925a6ecc tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:41.316196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86be8f9e-9b71-4324-ba91-c2bf925a6ecc tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:41.317015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86be8f9e-9b71-4324-ba91-c2bf925a6ecc tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:41.324858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86be8f9e-9b71-4324-ba91-c2bf925a6ecc tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:41.324858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86be8f9e-9b71-4324-ba91-c2bf925a6ecc tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:41.495576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-86be8f9e-9b71-4324-ba91-c2bf925a6ecc tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:41.503923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-86be8f9e-9b71-4324-ba91-c2bf925a6ecc tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.223364 Dec 15 16:24:41.504559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 301/588] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:41 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:41.628325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:41.629039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:41.635688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:41.636134 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:41.636980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:41.638767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:41.673323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:41.673766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:41.674219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lazy-loading 'fault' on Instance uuid a9c05d20-8ed1-4779-aa4f-387c1aaf77ba {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:41.720766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce7baeebd2974de2842369ccd0a588cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2df09e649444bf3bb3bc80331201c25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:41.729122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7b74d51d-09bb-4a24-803e-652c681a240f tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 200 len: 1304 microversion: 2.1 time: 0.105016 Dec 15 16:24:41.729703 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 288/589] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:41 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:42.521760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4d8a4511-72c0-42b2-9cac-c8fd2bc76ec8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:42.522441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4d8a4511-72c0-42b2-9cac-c8fd2bc76ec8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:42.530511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d8a4511-72c0-42b2-9cac-c8fd2bc76ec8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:42.530962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d8a4511-72c0-42b2-9cac-c8fd2bc76ec8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:42.531766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d8a4511-72c0-42b2-9cac-c8fd2bc76ec8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:42.532212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d8a4511-72c0-42b2-9cac-c8fd2bc76ec8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:42.686206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2568d05e-4e78-4e20-a8c0-fba803581daf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:42.686810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2568d05e-4e78-4e20-a8c0-fba803581daf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:42.693741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2568d05e-4e78-4e20-a8c0-fba803581daf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:42.694180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2568d05e-4e78-4e20-a8c0-fba803581daf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:42.695170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2568d05e-4e78-4e20-a8c0-fba803581daf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:42.695776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2568d05e-4e78-4e20-a8c0-fba803581daf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:42.726117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2568d05e-4e78-4e20-a8c0-fba803581daf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Going to try to terminate instance {{(pid=116022) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:42.804976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4d8a4511-72c0-42b2-9cac-c8fd2bc76ec8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:42.814199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4d8a4511-72c0-42b2-9cac-c8fd2bc76ec8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1508 microversion: 2.1 time: 0.296111 Dec 15 16:24:42.815478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 302/590] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:42 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:42.820407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-af41ebf3-ae1b-4d2f-8dae-04219acd46cb tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:42.821370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-af41ebf3-ae1b-4d2f-8dae-04219acd46cb tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] [instance: a9c05d20-8ed1-4779-aa4f-387c1aaf77ba] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:42.828742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af41ebf3-ae1b-4d2f-8dae-04219acd46cb tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:42.829352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af41ebf3-ae1b-4d2f-8dae-04219acd46cb tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:42.836274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af41ebf3-ae1b-4d2f-8dae-04219acd46cb tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:42.837392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af41ebf3-ae1b-4d2f-8dae-04219acd46cb tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:42.853047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-af41ebf3-ae1b-4d2f-8dae-04219acd46cb tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] HTTP exception thrown: Instance a9c05d20-8ed1-4779-aa4f-387c1aaf77ba could not be found. Dec 15 16:24:42.854042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-af41ebf3-ae1b-4d2f-8dae-04219acd46cb tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] Returning 404 to user: Instance a9c05d20-8ed1-4779-aa4f-387c1aaf77ba could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:42.854572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2568d05e-4e78-4e20-a8c0-fba803581daf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 204 len: 0 microversion: 2.1 time: 0.175449 Dec 15 16:24:42.855336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-af41ebf3-ae1b-4d2f-8dae-04219acd46cb tempest-VolumesActionsTest-482866562 tempest-VolumesActionsTest-482866562-project] 10.222.0.30 "GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba" status: 404 len: 111 microversion: 2.1 time: 0.038676 Dec 15 16:24:42.855886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 289/591] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:42 2021] DELETE /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:24:42.859403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 303/592] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:42 2021] GET /compute/v2.1/servers/a9c05d20-8ed1-4779-aa4f-387c1aaf77ba => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:42.869804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d1491e36-35b0-43db-bd27-b1f7d55ba31b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:42.871636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d1491e36-35b0-43db-bd27-b1f7d55ba31b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:42.886190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1491e36-35b0-43db-bd27-b1f7d55ba31b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:42.887086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1491e36-35b0-43db-bd27-b1f7d55ba31b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:42.888910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1491e36-35b0-43db-bd27-b1f7d55ba31b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:42.890028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1491e36-35b0-43db-bd27-b1f7d55ba31b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.148557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d1491e36-35b0-43db-bd27-b1f7d55ba31b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:43.159141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d1491e36-35b0-43db-bd27-b1f7d55ba31b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1511 microversion: 2.1 time: 0.297334 Dec 15 16:24:43.159991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 290/593] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:42 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:43.313780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-507197a5-a60b-4427-acdc-fee30cc7d086 req-aa060dd8-4928-416d-9a0b-743e1d8dc879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4f8510-3983-48f4-a221-d78d9c312bc3", "name": "network-vif-deleted", "tag": "69e4502f-377a-46f4-96d6-6d687f793676"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:43.315428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:43.315428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:24:43.323176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-507197a5-a60b-4427-acdc-fee30cc7d086 req-aa060dd8-4928-416d-9a0b-743e1d8dc879 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.323615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-507197a5-a60b-4427-acdc-fee30cc7d086 req-aa060dd8-4928-416d-9a0b-743e1d8dc879 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.335247 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-507197a5-a60b-4427-acdc-fee30cc7d086 req-aa060dd8-4928-416d-9a0b-743e1d8dc879 service nova] Creating event network-vif-deleted:69e4502f-377a-46f4-96d6-6d687f793676 for instance 4c4f8510-3983-48f4-a221-d78d9c312bc3 on hv-cinder-82002 Dec 15 16:24:43.340712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-507197a5-a60b-4427-acdc-fee30cc7d086 req-aa060dd8-4928-416d-9a0b-743e1d8dc879 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033253 Dec 15 16:24:43.341631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 304/594] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:43.832476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:43.833295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:43.840327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.840805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.841666 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.842135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.878720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.879161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.879642 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lazy-loading 'fault' on Instance uuid 4c4f8510-3983-48f4-a221-d78d9c312bc3 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:43.933916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:43.944352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fa35c61b-9e03-40a7-91c3-6694066f5e5e tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 200 len: 1311 microversion: 2.1 time: 0.115471 Dec 15 16:24:43.945232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 291/595] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:43 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:44.179197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0ae0b26d-03a0-47ba-b217-22d1a9218908 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:44.179930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0ae0b26d-03a0-47ba-b217-22d1a9218908 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:44.187132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ae0b26d-03a0-47ba-b217-22d1a9218908 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:44.187612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ae0b26d-03a0-47ba-b217-22d1a9218908 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:44.188423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ae0b26d-03a0-47ba-b217-22d1a9218908 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:44.188887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ae0b26d-03a0-47ba-b217-22d1a9218908 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:44.338047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0ae0b26d-03a0-47ba-b217-22d1a9218908 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:44.345960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0ae0b26d-03a0-47ba-b217-22d1a9218908 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1511 microversion: 2.1 time: 0.171278 Dec 15 16:24:44.346545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 305/596] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:44 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:44.967155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa39f11b-a406-4b3f-aae6-d2acc30053ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:44.967790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa39f11b-a406-4b3f-aae6-d2acc30053ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 4c4f8510-3983-48f4-a221-d78d9c312bc3] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:44.974775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa39f11b-a406-4b3f-aae6-d2acc30053ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:44.975130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa39f11b-a406-4b3f-aae6-d2acc30053ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:44.975921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa39f11b-a406-4b3f-aae6-d2acc30053ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:44.976353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa39f11b-a406-4b3f-aae6-d2acc30053ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:44.991273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-aa39f11b-a406-4b3f-aae6-d2acc30053ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] HTTP exception thrown: Instance 4c4f8510-3983-48f4-a221-d78d9c312bc3 could not be found. Dec 15 16:24:44.991880 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa39f11b-a406-4b3f-aae6-d2acc30053ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Returning 404 to user: Instance 4c4f8510-3983-48f4-a221-d78d9c312bc3 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:44.992772 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa39f11b-a406-4b3f-aae6-d2acc30053ad tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3" status: 404 len: 111 microversion: 2.1 time: 0.029452 Dec 15 16:24:44.993328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 292/597] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:44 2021] GET /compute/v2.1/servers/4c4f8510-3983-48f4-a221-d78d9c312bc3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:45.003317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-af2902b9-85b3-481b-b848-dd22a4c3959f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:45.004173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-af2902b9-85b3-481b-b848-dd22a4c3959f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:45.012086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af2902b9-85b3-481b-b848-dd22a4c3959f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.012690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af2902b9-85b3-481b-b848-dd22a4c3959f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:45.013583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af2902b9-85b3-481b-b848-dd22a4c3959f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.014113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-af2902b9-85b3-481b-b848-dd22a4c3959f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:45.041060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-af2902b9-85b3-481b-b848-dd22a4c3959f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:45.131530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-af2902b9-85b3-481b-b848-dd22a4c3959f tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 204 len: 0 microversion: 2.1 time: 0.132921 Dec 15 16:24:45.132161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 306/598] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:44 2021] DELETE /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:24:45.140615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2fabacbb-4301-4a50-ac7c-b34473cb623c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:45.141224 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2fabacbb-4301-4a50-ac7c-b34473cb623c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:45.147794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2fabacbb-4301-4a50-ac7c-b34473cb623c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.148234 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2fabacbb-4301-4a50-ac7c-b34473cb623c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:45.149064 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2fabacbb-4301-4a50-ac7c-b34473cb623c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.149495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2fabacbb-4301-4a50-ac7c-b34473cb623c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:45.301888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2fabacbb-4301-4a50-ac7c-b34473cb623c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:45.310239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2fabacbb-4301-4a50-ac7c-b34473cb623c tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.173399 Dec 15 16:24:45.310851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 293/599] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:45 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:45.365376 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-74efa510-61df-48eb-b8a1-4c7d6abf5772 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:45.366099 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-74efa510-61df-48eb-b8a1-4c7d6abf5772 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:45.373365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74efa510-61df-48eb-b8a1-4c7d6abf5772 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.373834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74efa510-61df-48eb-b8a1-4c7d6abf5772 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:45.374827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74efa510-61df-48eb-b8a1-4c7d6abf5772 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.375287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74efa510-61df-48eb-b8a1-4c7d6abf5772 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:45.523210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-74efa510-61df-48eb-b8a1-4c7d6abf5772 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:45.531233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-74efa510-61df-48eb-b8a1-4c7d6abf5772 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1511 microversion: 2.1 time: 0.170115 Dec 15 16:24:45.531825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 307/600] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:45 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:46.328321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-63c924ca-8ac6-4caa-837c-955a20b8c7c8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:46.329047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-63c924ca-8ac6-4caa-837c-955a20b8c7c8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:46.335950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63c924ca-8ac6-4caa-837c-955a20b8c7c8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:46.336402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63c924ca-8ac6-4caa-837c-955a20b8c7c8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:46.337244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63c924ca-8ac6-4caa-837c-955a20b8c7c8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:46.337757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63c924ca-8ac6-4caa-837c-955a20b8c7c8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:46.486037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-63c924ca-8ac6-4caa-837c-955a20b8c7c8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:46.495337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-63c924ca-8ac6-4caa-837c-955a20b8c7c8 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.171005 Dec 15 16:24:46.496028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 294/601] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:46 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:46.548057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d88f24c9-fbd7-4465-97b0-0ca3ccf7334a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:46.548717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d88f24c9-fbd7-4465-97b0-0ca3ccf7334a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:46.555759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d88f24c9-fbd7-4465-97b0-0ca3ccf7334a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:46.556239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d88f24c9-fbd7-4465-97b0-0ca3ccf7334a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:46.557112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d88f24c9-fbd7-4465-97b0-0ca3ccf7334a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:46.557541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d88f24c9-fbd7-4465-97b0-0ca3ccf7334a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:46.710001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d88f24c9-fbd7-4465-97b0-0ca3ccf7334a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:46.718488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d88f24c9-fbd7-4465-97b0-0ca3ccf7334a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1511 microversion: 2.1 time: 0.174114 Dec 15 16:24:46.719091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 308/602] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:46 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:47.512908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa45c132-de22-4123-b090-f59f886dc997 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:47.513514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa45c132-de22-4123-b090-f59f886dc997 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:47.520163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa45c132-de22-4123-b090-f59f886dc997 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:47.520675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa45c132-de22-4123-b090-f59f886dc997 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:47.521445 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa45c132-de22-4123-b090-f59f886dc997 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:47.521873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa45c132-de22-4123-b090-f59f886dc997 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:47.674604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa45c132-de22-4123-b090-f59f886dc997 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:47.686421 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa45c132-de22-4123-b090-f59f886dc997 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.176906 Dec 15 16:24:47.687509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 295/603] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:47 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:47.736893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8465b69a-9fd0-4dde-86a4-5357f27200b4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:47.737517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8465b69a-9fd0-4dde-86a4-5357f27200b4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:47.745176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8465b69a-9fd0-4dde-86a4-5357f27200b4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:47.745625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8465b69a-9fd0-4dde-86a4-5357f27200b4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:47.746515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8465b69a-9fd0-4dde-86a4-5357f27200b4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:47.746942 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8465b69a-9fd0-4dde-86a4-5357f27200b4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:47.899451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8465b69a-9fd0-4dde-86a4-5357f27200b4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:47.907736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8465b69a-9fd0-4dde-86a4-5357f27200b4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1511 microversion: 2.1 time: 0.174919 Dec 15 16:24:47.908332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 309/604] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:47 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:48.712679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-885b1e6f-848b-4602-b6b4-af4103dfea47 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:48.713305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-885b1e6f-848b-4602-b6b4-af4103dfea47 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:48.720775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-885b1e6f-848b-4602-b6b4-af4103dfea47 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:48.721278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-885b1e6f-848b-4602-b6b4-af4103dfea47 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:48.722142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-885b1e6f-848b-4602-b6b4-af4103dfea47 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:48.722737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-885b1e6f-848b-4602-b6b4-af4103dfea47 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:48.891594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-885b1e6f-848b-4602-b6b4-af4103dfea47 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:48.899669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-885b1e6f-848b-4602-b6b4-af4103dfea47 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.190743 Dec 15 16:24:48.900336 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 296/605] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:48 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:48.925453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fcc1b978-31a2-44ce-99f1-e782ea07b7fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:48.926068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fcc1b978-31a2-44ce-99f1-e782ea07b7fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:48.933469 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcc1b978-31a2-44ce-99f1-e782ea07b7fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:48.933895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcc1b978-31a2-44ce-99f1-e782ea07b7fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:48.934725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcc1b978-31a2-44ce-99f1-e782ea07b7fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:48.935159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcc1b978-31a2-44ce-99f1-e782ea07b7fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:49.088384 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fcc1b978-31a2-44ce-99f1-e782ea07b7fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:49.096125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fcc1b978-31a2-44ce-99f1-e782ea07b7fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1511 microversion: 2.1 time: 0.174376 Dec 15 16:24:49.096762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 310/606] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:48 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:49.918204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d816d55a-0215-44b6-975b-24f257ba3eb4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:49.919483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d816d55a-0215-44b6-975b-24f257ba3eb4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:49.926695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d816d55a-0215-44b6-975b-24f257ba3eb4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:49.927780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d816d55a-0215-44b6-975b-24f257ba3eb4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:49.928880 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d816d55a-0215-44b6-975b-24f257ba3eb4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:49.929494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d816d55a-0215-44b6-975b-24f257ba3eb4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:50.115824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d73b0253-c929-443b-aeb2-3ff2fa2bdf97 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:50.128061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d73b0253-c929-443b-aeb2-3ff2fa2bdf97 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:50.137707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d73b0253-c929-443b-aeb2-3ff2fa2bdf97 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:50.138908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d73b0253-c929-443b-aeb2-3ff2fa2bdf97 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:50.139995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d73b0253-c929-443b-aeb2-3ff2fa2bdf97 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:50.140668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d73b0253-c929-443b-aeb2-3ff2fa2bdf97 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:50.229037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d816d55a-0215-44b6-975b-24f257ba3eb4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:50.240990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d816d55a-0215-44b6-975b-24f257ba3eb4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.327243 Dec 15 16:24:50.242145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 297/607] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:49 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:50.405472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d73b0253-c929-443b-aeb2-3ff2fa2bdf97 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:50.416730 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d73b0253-c929-443b-aeb2-3ff2fa2bdf97 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1511 microversion: 2.1 time: 0.305210 Dec 15 16:24:50.427969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 311/608] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:50 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:50.654483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-59694453-4a1f-45a8-bf3c-ab71a6f892d7 req-8bdb1441-e9d1-484b-a1e5-5832b3df40bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02506a5c-6c61-442c-bedf-ffbe1dd23ff2", "name": "network-vif-deleted", "tag": "08fcafa5-25ff-42a0-9063-587833cff4a1"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:50.658581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:50.658581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:24:50.672235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-59694453-4a1f-45a8-bf3c-ab71a6f892d7 req-8bdb1441-e9d1-484b-a1e5-5832b3df40bb service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:50.673059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-59694453-4a1f-45a8-bf3c-ab71a6f892d7 req-8bdb1441-e9d1-484b-a1e5-5832b3df40bb service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:50.691046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-59694453-4a1f-45a8-bf3c-ab71a6f892d7 req-8bdb1441-e9d1-484b-a1e5-5832b3df40bb service nova] Creating event network-vif-deleted:08fcafa5-25ff-42a0-9063-587833cff4a1 for instance 02506a5c-6c61-442c-bedf-ffbe1dd23ff2 on hv-cinder-82002 Dec 15 16:24:50.698293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-59694453-4a1f-45a8-bf3c-ab71a6f892d7 req-8bdb1441-e9d1-484b-a1e5-5832b3df40bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050271 Dec 15 16:24:50.699742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 298/609] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:51.258747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a55513d5-3d21-4122-9993-bae295d5b6ba tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:51.259332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a55513d5-3d21-4122-9993-bae295d5b6ba tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:51.265507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a55513d5-3d21-4122-9993-bae295d5b6ba tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:51.266215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a55513d5-3d21-4122-9993-bae295d5b6ba tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:51.267015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a55513d5-3d21-4122-9993-bae295d5b6ba tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:51.267437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a55513d5-3d21-4122-9993-bae295d5b6ba tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:51.435276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:51.436000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:51.453850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:51.454745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:51.455924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:51.456900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:51.536735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:51.537628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:51.538413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lazy-loading 'fault' on Instance uuid 02506a5c-6c61-442c-bedf-ffbe1dd23ff2 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:51.691107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:51.703140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ae206a78-ca9d-4fa7-8c46-2fd3eaa97bd6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 200 len: 1307 microversion: 2.1 time: 0.271754 Dec 15 16:24:51.703890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 299/610] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:51 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:51.753783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a55513d5-3d21-4122-9993-bae295d5b6ba tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:51.761623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a55513d5-3d21-4122-9993-bae295d5b6ba tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.506778 Dec 15 16:24:51.771470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 312/611] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:51 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:52.723175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-94ce2f68-517e-450f-b426-ff393dbfd560 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:52.723793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-94ce2f68-517e-450f-b426-ff393dbfd560 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 02506a5c-6c61-442c-bedf-ffbe1dd23ff2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:52.731939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94ce2f68-517e-450f-b426-ff393dbfd560 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:52.732384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94ce2f68-517e-450f-b426-ff393dbfd560 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:52.733196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94ce2f68-517e-450f-b426-ff393dbfd560 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:52.733804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94ce2f68-517e-450f-b426-ff393dbfd560 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:52.748316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-94ce2f68-517e-450f-b426-ff393dbfd560 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] HTTP exception thrown: Instance 02506a5c-6c61-442c-bedf-ffbe1dd23ff2 could not be found. Dec 15 16:24:52.748962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-94ce2f68-517e-450f-b426-ff393dbfd560 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Returning 404 to user: Instance 02506a5c-6c61-442c-bedf-ffbe1dd23ff2 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:52.749982 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-94ce2f68-517e-450f-b426-ff393dbfd560 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2" status: 404 len: 111 microversion: 2.1 time: 0.030622 Dec 15 16:24:52.750530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 300/612] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:52 2021] GET /compute/v2.1/servers/02506a5c-6c61-442c-bedf-ffbe1dd23ff2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:52.779974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-604699c9-94a8-47c9-b356-ed1054b351f0 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:52.780630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-604699c9-94a8-47c9-b356-ed1054b351f0 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:52.787362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-604699c9-94a8-47c9-b356-ed1054b351f0 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:52.788048 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-604699c9-94a8-47c9-b356-ed1054b351f0 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:52.789081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-604699c9-94a8-47c9-b356-ed1054b351f0 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:52.789687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-604699c9-94a8-47c9-b356-ed1054b351f0 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:53.003516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-604699c9-94a8-47c9-b356-ed1054b351f0 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:53.020378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-604699c9-94a8-47c9-b356-ed1054b351f0 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.245359 Dec 15 16:24:53.021123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 313/613] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:52 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:54.043478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-91f82080-cf30-47cc-b2b4-c544d993afd7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:54.045991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-91f82080-cf30-47cc-b2b4-c544d993afd7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:54.058291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91f82080-cf30-47cc-b2b4-c544d993afd7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:54.059434 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91f82080-cf30-47cc-b2b4-c544d993afd7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:54.060885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91f82080-cf30-47cc-b2b4-c544d993afd7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:54.062104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91f82080-cf30-47cc-b2b4-c544d993afd7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:54.259570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-91f82080-cf30-47cc-b2b4-c544d993afd7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:54.272960 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-91f82080-cf30-47cc-b2b4-c544d993afd7 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.236092 Dec 15 16:24:54.274030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 301/614] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:54 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:55.298824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-96e54518-b4a3-420b-9763-302999f5c657 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:55.299648 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-96e54518-b4a3-420b-9763-302999f5c657 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:55.306032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96e54518-b4a3-420b-9763-302999f5c657 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:55.306748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96e54518-b4a3-420b-9763-302999f5c657 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:55.307729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96e54518-b4a3-420b-9763-302999f5c657 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:55.308159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96e54518-b4a3-420b-9763-302999f5c657 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:55.461812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-96e54518-b4a3-420b-9763-302999f5c657 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:55.470354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-96e54518-b4a3-420b-9763-302999f5c657 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.175159 Dec 15 16:24:55.470960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 314/615] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:55 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:56.489306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5b42aa27-6beb-4288-b397-19709777712b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:56.490230 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5b42aa27-6beb-4288-b397-19709777712b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:56.497582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b42aa27-6beb-4288-b397-19709777712b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:56.498144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b42aa27-6beb-4288-b397-19709777712b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:56.499036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b42aa27-6beb-4288-b397-19709777712b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:56.499940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b42aa27-6beb-4288-b397-19709777712b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:56.665435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5b42aa27-6beb-4288-b397-19709777712b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:56.675185 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5b42aa27-6beb-4288-b397-19709777712b tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.189929 Dec 15 16:24:56.676139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 302/616] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:56 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:57.697369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9fc11221-04ef-4d46-ba28-accfb2fb9490 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:57.700128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9fc11221-04ef-4d46-ba28-accfb2fb9490 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:57.709011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9fc11221-04ef-4d46-ba28-accfb2fb9490 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:57.709905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9fc11221-04ef-4d46-ba28-accfb2fb9490 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:57.710986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9fc11221-04ef-4d46-ba28-accfb2fb9490 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:57.711593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9fc11221-04ef-4d46-ba28-accfb2fb9490 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:57.989292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9fc11221-04ef-4d46-ba28-accfb2fb9490 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:58.006273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9fc11221-04ef-4d46-ba28-accfb2fb9490 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.312949 Dec 15 16:24:58.022540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 315/617] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:57 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:59.032015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-14e0806b-dcc2-40d9-a4ea-45a9daa89152 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:59.033647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-14e0806b-dcc2-40d9-a4ea-45a9daa89152 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:59.043906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14e0806b-dcc2-40d9-a4ea-45a9daa89152 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:59.044392 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14e0806b-dcc2-40d9-a4ea-45a9daa89152 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:59.045357 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14e0806b-dcc2-40d9-a4ea-45a9daa89152 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:59.045849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14e0806b-dcc2-40d9-a4ea-45a9daa89152 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:59.346166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-14e0806b-dcc2-40d9-a4ea-45a9daa89152 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:59.359061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-14e0806b-dcc2-40d9-a4ea-45a9daa89152 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.333827 Dec 15 16:24:59.359807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 303/618] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:59 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:00.376836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c86fd106-f8cd-44a8-b214-89d9872e8ef3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:00.377415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c86fd106-f8cd-44a8-b214-89d9872e8ef3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:00.386707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c86fd106-f8cd-44a8-b214-89d9872e8ef3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:00.387144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c86fd106-f8cd-44a8-b214-89d9872e8ef3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:00.387972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c86fd106-f8cd-44a8-b214-89d9872e8ef3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:00.388691 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c86fd106-f8cd-44a8-b214-89d9872e8ef3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:00.562680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c86fd106-f8cd-44a8-b214-89d9872e8ef3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:00.570986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c86fd106-f8cd-44a8-b214-89d9872e8ef3 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.197926 Dec 15 16:25:00.572825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 316/619] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:00 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:01.591729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-65a51627-6313-4318-84d0-54e7b776bec4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:01.592833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-65a51627-6313-4318-84d0-54e7b776bec4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:01.606312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65a51627-6313-4318-84d0-54e7b776bec4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:01.607281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65a51627-6313-4318-84d0-54e7b776bec4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:01.608287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65a51627-6313-4318-84d0-54e7b776bec4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:01.609068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65a51627-6313-4318-84d0-54e7b776bec4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:01.752112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-65a51627-6313-4318-84d0-54e7b776bec4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:01.760924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-65a51627-6313-4318-84d0-54e7b776bec4 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.174799 Dec 15 16:25:01.761621 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 304/620] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:01 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:02.778133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6e4918f1-23ad-4bd8-949e-06996fc58212 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:02.778727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6e4918f1-23ad-4bd8-949e-06996fc58212 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:02.785641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e4918f1-23ad-4bd8-949e-06996fc58212 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:02.786142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e4918f1-23ad-4bd8-949e-06996fc58212 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:02.787064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e4918f1-23ad-4bd8-949e-06996fc58212 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:02.787438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e4918f1-23ad-4bd8-949e-06996fc58212 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:02.941598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6e4918f1-23ad-4bd8-949e-06996fc58212 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:02.950944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6e4918f1-23ad-4bd8-949e-06996fc58212 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.176275 Dec 15 16:25:02.960506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 317/621] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:02 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:03.970141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-38299f38-3743-44d8-8876-af3b68274943 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:03.970863 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-38299f38-3743-44d8-8876-af3b68274943 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:03.978564 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-38299f38-3743-44d8-8876-af3b68274943 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:03.979631 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-38299f38-3743-44d8-8876-af3b68274943 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:03.979990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-38299f38-3743-44d8-8876-af3b68274943 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:03.980522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-38299f38-3743-44d8-8876-af3b68274943 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:04.137806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-38299f38-3743-44d8-8876-af3b68274943 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:04.149034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-38299f38-3743-44d8-8876-af3b68274943 tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1522 microversion: 2.1 time: 0.183238 Dec 15 16:25:04.157479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 305/622] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:03 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:04.946766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-668ed49f-f578-403d-aeb8-44504c8d1573 req-68715798-84bf-4e64-bd33-01e90b66f55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7177930d-42eb-410e-a836-4287e9d78300", "name": "network-vif-deleted", "tag": "ae8e0edc-0aca-49bd-a855-113d2a32241a"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:04.948403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:04.948403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:25:04.959637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-668ed49f-f578-403d-aeb8-44504c8d1573 req-68715798-84bf-4e64-bd33-01e90b66f55a service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:04.961511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-668ed49f-f578-403d-aeb8-44504c8d1573 req-68715798-84bf-4e64-bd33-01e90b66f55a service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:04.974133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-668ed49f-f578-403d-aeb8-44504c8d1573 req-68715798-84bf-4e64-bd33-01e90b66f55a service nova] Creating event network-vif-deleted:ae8e0edc-0aca-49bd-a855-113d2a32241a for instance 7177930d-42eb-410e-a836-4287e9d78300 on hv-cinder-82002 Dec 15 16:25:04.983430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-668ed49f-f578-403d-aeb8-44504c8d1573 req-68715798-84bf-4e64-bd33-01e90b66f55a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040141 Dec 15 16:25:04.984828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 318/623] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:25:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:05.036900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1489895641", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "networks": [{"uuid": "0f2cb22b-70c8-4550-8ada-2ef9ecc0396f"}]}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:05.137800 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.network.neutron [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] validate_networks() for [('0f2cb22b-70c8-4550-8ada-2ef9ecc0396f', None, None, None, None, None)] {{(pid=116022) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:25:05.169412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:05.170351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:05.186133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:05.190943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:05.192603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:05.193297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:05.242709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:05.243502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:05.244882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lazy-loading 'fault' on Instance uuid 7177930d-42eb-410e-a836-4287e9d78300 {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:25:05.308599 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17203383b6ed406a959b7a93cf184c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe8b4fae71c484f939fd5379ad2ff16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:05.325417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0269ed01-3e75-404a-a0ad-26db0e5a924a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 200 len: 1311 microversion: 2.1 time: 0.161699 Dec 15 16:25:05.335569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 319/624] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:05 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 1311 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:05.719669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Flavor limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:25:05.720084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Image limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:25:05.720584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Flavor pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:25:05.721329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Image pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:25:05.721895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:25:05.742137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:05.742727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:05.743828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:05.745374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:05.777084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Getting quotas for project 2ce9eb0396d945e692eb72ae3f344a66. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:25:05.783041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Getting quotas for user 525625cf3f3a4381a828f58b8ac056f3 and project 2ce9eb0396d945e692eb72ae3f344a66. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:25:05.804892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Going to run 1 instances... {{(pid=116022) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:25:05.813980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:25:05.880331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-782739c4-82bd-45d5-a49b-7c2c608c0aba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849032 Dec 15 16:25:05.881030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 306/625] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:25:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:25:05.891049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fa2bd158-6c0d-474b-ba57-2c44090eca14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:05.891578 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fa2bd158-6c0d-474b-ba57-2c44090eca14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:06.023852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fa2bd158-6c0d-474b-ba57-2c44090eca14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:06.033865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fa2bd158-6c0d-474b-ba57-2c44090eca14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1219 microversion: 2.1 time: 0.146515 Dec 15 16:25:06.035070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 320/626] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:05 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:06.351696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6fcf7bc9-f407-41d8-a918-aef4ba071e0a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:06.354687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6fcf7bc9-f407-41d8-a918-aef4ba071e0a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] [instance: 7177930d-42eb-410e-a836-4287e9d78300] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:06.373883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6fcf7bc9-f407-41d8-a918-aef4ba071e0a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:06.374500 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6fcf7bc9-f407-41d8-a918-aef4ba071e0a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:06.375570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6fcf7bc9-f407-41d8-a918-aef4ba071e0a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:06.376170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6fcf7bc9-f407-41d8-a918-aef4ba071e0a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:06.397569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-6fcf7bc9-f407-41d8-a918-aef4ba071e0a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] HTTP exception thrown: Instance 7177930d-42eb-410e-a836-4287e9d78300 could not be found. Dec 15 16:25:06.398186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6fcf7bc9-f407-41d8-a918-aef4ba071e0a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] Returning 404 to user: Instance 7177930d-42eb-410e-a836-4287e9d78300 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:25:06.399045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6fcf7bc9-f407-41d8-a918-aef4ba071e0a tempest-ServerRescueNegativeTestJSON-117487334 tempest-ServerRescueNegativeTestJSON-117487334-project] 10.222.0.30 "GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300" status: 404 len: 111 microversion: 2.1 time: 0.055207 Dec 15 16:25:06.399620 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 307/627] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:06 2021] GET /compute/v2.1/servers/7177930d-42eb-410e-a836-4287e9d78300 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:25:07.055776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cfb9c7c0-bb6b-4912-815d-1c08edd80b0f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:07.058237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cfb9c7c0-bb6b-4912-815d-1c08edd80b0f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:07.066486 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cfb9c7c0-bb6b-4912-815d-1c08edd80b0f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:07.067283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cfb9c7c0-bb6b-4912-815d-1c08edd80b0f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:07.068296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cfb9c7c0-bb6b-4912-815d-1c08edd80b0f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:07.069022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cfb9c7c0-bb6b-4912-815d-1c08edd80b0f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:07.223993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cfb9c7c0-bb6b-4912-815d-1c08edd80b0f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:07.234078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cfb9c7c0-bb6b-4912-815d-1c08edd80b0f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1271 microversion: 2.1 time: 0.185886 Dec 15 16:25:07.244967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 321/628] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:07 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:08.253825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-272a85e7-0447-4791-b9c1-00b93d30b062 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:08.254555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-272a85e7-0447-4791-b9c1-00b93d30b062 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:08.262107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-272a85e7-0447-4791-b9c1-00b93d30b062 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:08.262531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-272a85e7-0447-4791-b9c1-00b93d30b062 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:08.263418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-272a85e7-0447-4791-b9c1-00b93d30b062 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:08.263929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-272a85e7-0447-4791-b9c1-00b93d30b062 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:08.405543 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-272a85e7-0447-4791-b9c1-00b93d30b062 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:08.413754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-272a85e7-0447-4791-b9c1-00b93d30b062 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1277 microversion: 2.1 time: 0.163569 Dec 15 16:25:08.425370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 308/629] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:08 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:09.434226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9ef77bb7-00a8-4e1a-bf52-f9150791a4cc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:09.434965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9ef77bb7-00a8-4e1a-bf52-f9150791a4cc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:09.442186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ef77bb7-00a8-4e1a-bf52-f9150791a4cc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:09.442624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ef77bb7-00a8-4e1a-bf52-f9150791a4cc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:09.443910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ef77bb7-00a8-4e1a-bf52-f9150791a4cc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:09.444411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ef77bb7-00a8-4e1a-bf52-f9150791a4cc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:09.737112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9ef77bb7-00a8-4e1a-bf52-f9150791a4cc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:09.749033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9ef77bb7-00a8-4e1a-bf52-f9150791a4cc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1319 microversion: 2.1 time: 0.320310 Dec 15 16:25:09.750042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 322/630] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:09 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:09.923728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-406dd1a8-96f5-4b74-9fc4-30bbff29b91c req-d83e623e-a8e0-42d2-a7b6-81aecaee4b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96293447-9fd5-4150-abbe-a00f77eb0094", "tag": "fd46da54-de89-4927-beb0-fce5e08a5d2a"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:09.929704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:09.929704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:25:09.941434 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-406dd1a8-96f5-4b74-9fc4-30bbff29b91c req-d83e623e-a8e0-42d2-a7b6-81aecaee4b9e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:09.942291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-406dd1a8-96f5-4b74-9fc4-30bbff29b91c req-d83e623e-a8e0-42d2-a7b6-81aecaee4b9e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:09.960627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-406dd1a8-96f5-4b74-9fc4-30bbff29b91c req-d83e623e-a8e0-42d2-a7b6-81aecaee4b9e service nova] Creating event network-changed:fd46da54-de89-4927-beb0-fce5e08a5d2a for instance 96293447-9fd5-4150-abbe-a00f77eb0094 on hv-cinder-82002 Dec 15 16:25:09.966193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-406dd1a8-96f5-4b74-9fc4-30bbff29b91c req-d83e623e-a8e0-42d2-a7b6-81aecaee4b9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049414 Dec 15 16:25:09.967056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 309/631] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:25:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:10.769417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1b3101f2-a850-454f-a8d5-a97980aa93e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:10.770147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1b3101f2-a850-454f-a8d5-a97980aa93e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:10.778768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b3101f2-a850-454f-a8d5-a97980aa93e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:10.779629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b3101f2-a850-454f-a8d5-a97980aa93e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:10.781185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b3101f2-a850-454f-a8d5-a97980aa93e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:10.781692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b3101f2-a850-454f-a8d5-a97980aa93e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:11.061409 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1b3101f2-a850-454f-a8d5-a97980aa93e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:11.070101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1b3101f2-a850-454f-a8d5-a97980aa93e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1319 microversion: 2.1 time: 0.306784 Dec 15 16:25:11.071071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 323/632] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:10 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:12.090922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4a59955e-c79a-41bf-b6c2-33a1e6a3c3ea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:12.092302 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4a59955e-c79a-41bf-b6c2-33a1e6a3c3ea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:12.105282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a59955e-c79a-41bf-b6c2-33a1e6a3c3ea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:12.106192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a59955e-c79a-41bf-b6c2-33a1e6a3c3ea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:12.107826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a59955e-c79a-41bf-b6c2-33a1e6a3c3ea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:12.109777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a59955e-c79a-41bf-b6c2-33a1e6a3c3ea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:12.327632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4a59955e-c79a-41bf-b6c2-33a1e6a3c3ea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:12.341069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4a59955e-c79a-41bf-b6c2-33a1e6a3c3ea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1319 microversion: 2.1 time: 0.254956 Dec 15 16:25:12.342586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 310/633] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:12 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:13.363223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-61f93fce-738c-42ab-a9e9-1568d4f50033 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:13.365543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-61f93fce-738c-42ab-a9e9-1568d4f50033 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:13.376997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61f93fce-738c-42ab-a9e9-1568d4f50033 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:13.377953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61f93fce-738c-42ab-a9e9-1568d4f50033 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:13.379634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61f93fce-738c-42ab-a9e9-1568d4f50033 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:13.380672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61f93fce-738c-42ab-a9e9-1568d4f50033 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:13.655858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-61f93fce-738c-42ab-a9e9-1568d4f50033 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:13.678956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-61f93fce-738c-42ab-a9e9-1568d4f50033 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1319 microversion: 2.1 time: 0.320780 Dec 15 16:25:13.686476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 324/634] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:13 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:14.632891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-930409641", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "networks": [{"uuid": "f8e92bdd-a152-4645-9bd2-aa6efe85b650"}]}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:14.686360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.network.neutron [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] validate_networks() for [('f8e92bdd-a152-4645-9bd2-aa6efe85b650', None, None, None, None, None)] {{(pid=116022) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:25:14.702388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-68c274c8-4f21-4c66-bdf0-b0632c8ee669 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:14.703001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-68c274c8-4f21-4c66-bdf0-b0632c8ee669 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:14.709978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68c274c8-4f21-4c66-bdf0-b0632c8ee669 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:14.710269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68c274c8-4f21-4c66-bdf0-b0632c8ee669 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:14.711397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68c274c8-4f21-4c66-bdf0-b0632c8ee669 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:14.711825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68c274c8-4f21-4c66-bdf0-b0632c8ee669 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:14.933333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-68c274c8-4f21-4c66-bdf0-b0632c8ee669 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:14.941577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-68c274c8-4f21-4c66-bdf0-b0632c8ee669 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1319 microversion: 2.1 time: 0.242916 Dec 15 16:25:14.945235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 325/635] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:14 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:15.155722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Flavor limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:25:15.157083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Image limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:25:15.157742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Flavor pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:25:15.158314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Image pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:25:15.159132 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:25:15.171232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:15.171941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:15.172982 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:15.173608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:15.193449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Getting quotas for project 370dfab4258d483f94f4dc1cbce64954. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:25:15.198525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Getting quotas for user 2a2f7c8ccd2541babbb2eb7503463cd6 and project 370dfab4258d483f94f4dc1cbce64954. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:25:15.216339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Going to run 1 instances... {{(pid=116022) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:25:15.218707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:25:15.269617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-69030d22-5ddc-482c-a17a-e1108f812fc9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852016 Dec 15 16:25:15.270585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 311/636] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:25:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:25:15.280795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bdc8b5a3-79fd-4360-b182-c7d61af04ead tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:15.281855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bdc8b5a3-79fd-4360-b182-c7d61af04ead tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:15.354421 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bdc8b5a3-79fd-4360-b182-c7d61af04ead tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:15.362731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bdc8b5a3-79fd-4360-b182-c7d61af04ead tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1217 microversion: 2.1 time: 0.086256 Dec 15 16:25:15.363661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 326/637] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:15 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:15.961989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-42c246a1-a5a3-46b6-9ba0-c99b3f1a7a57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:15.966155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-42c246a1-a5a3-46b6-9ba0-c99b3f1a7a57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:15.983419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42c246a1-a5a3-46b6-9ba0-c99b3f1a7a57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:15.984250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42c246a1-a5a3-46b6-9ba0-c99b3f1a7a57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:15.986769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42c246a1-a5a3-46b6-9ba0-c99b3f1a7a57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:15.987459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42c246a1-a5a3-46b6-9ba0-c99b3f1a7a57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:16.238136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-42c246a1-a5a3-46b6-9ba0-c99b3f1a7a57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:16.258202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-42c246a1-a5a3-46b6-9ba0-c99b3f1a7a57 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1319 microversion: 2.1 time: 0.301198 Dec 15 16:25:16.258810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 312/638] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:15 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:16.379431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-667c280c-5ad7-493b-b1e2-5a5f94e66a5a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:16.380176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-667c280c-5ad7-493b-b1e2-5a5f94e66a5a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:16.388382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-667c280c-5ad7-493b-b1e2-5a5f94e66a5a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:16.389791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-667c280c-5ad7-493b-b1e2-5a5f94e66a5a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:16.390744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-667c280c-5ad7-493b-b1e2-5a5f94e66a5a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:16.391309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-667c280c-5ad7-493b-b1e2-5a5f94e66a5a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:16.496136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-667c280c-5ad7-493b-b1e2-5a5f94e66a5a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:16.504171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-667c280c-5ad7-493b-b1e2-5a5f94e66a5a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1269 microversion: 2.1 time: 0.128754 Dec 15 16:25:16.505229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 327/639] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:16 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1269 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:16.580868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-4a3f3290-7da7-4195-bc64-6f813a14585d req-2544de29-f60a-4a42-8415-32e463eb0532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96293447-9fd5-4150-abbe-a00f77eb0094", "name": "network-vif-plugged", "status": "completed", "tag": "fd46da54-de89-4927-beb0-fce5e08a5d2a"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:16.583756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:16.583756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:25:16.598632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-4a3f3290-7da7-4195-bc64-6f813a14585d req-2544de29-f60a-4a42-8415-32e463eb0532 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:16.599243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-4a3f3290-7da7-4195-bc64-6f813a14585d req-2544de29-f60a-4a42-8415-32e463eb0532 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:16.622513 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-4a3f3290-7da7-4195-bc64-6f813a14585d req-2544de29-f60a-4a42-8415-32e463eb0532 service nova] Creating event network-vif-plugged:fd46da54-de89-4927-beb0-fce5e08a5d2a for instance 96293447-9fd5-4150-abbe-a00f77eb0094 on hv-cinder-82002 Dec 15 16:25:16.630366 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-4a3f3290-7da7-4195-bc64-6f813a14585d req-2544de29-f60a-4a42-8415-32e463eb0532 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055318 Dec 15 16:25:16.631313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 313/640] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:25:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:17.275605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e26be35d-5b4a-415b-819e-e47aed9c6e5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:17.276324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e26be35d-5b4a-415b-819e-e47aed9c6e5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:17.284884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e26be35d-5b4a-415b-819e-e47aed9c6e5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:17.285580 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e26be35d-5b4a-415b-819e-e47aed9c6e5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:17.286589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e26be35d-5b4a-415b-819e-e47aed9c6e5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:17.287184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e26be35d-5b4a-415b-819e-e47aed9c6e5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:17.527753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-73079fc5-edfa-4a30-af8c-dfc8c88ee34b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:17.530826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-73079fc5-edfa-4a30-af8c-dfc8c88ee34b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:17.539592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73079fc5-edfa-4a30-af8c-dfc8c88ee34b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:17.539592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73079fc5-edfa-4a30-af8c-dfc8c88ee34b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:17.540300 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73079fc5-edfa-4a30-af8c-dfc8c88ee34b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:17.540768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73079fc5-edfa-4a30-af8c-dfc8c88ee34b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:17.693858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-73079fc5-edfa-4a30-af8c-dfc8c88ee34b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:17.703782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-73079fc5-edfa-4a30-af8c-dfc8c88ee34b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1275 microversion: 2.1 time: 0.183720 Dec 15 16:25:17.715063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 314/641] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:17 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:17.731915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e26be35d-5b4a-415b-819e-e47aed9c6e5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:17.743337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e26be35d-5b4a-415b-819e-e47aed9c6e5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1319 microversion: 2.1 time: 0.471321 Dec 15 16:25:17.760051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 328/642] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:17 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:18.722115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5e212b6e-a4b8-4eeb-844d-adfc1b1b71ed tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:18.723958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5e212b6e-a4b8-4eeb-844d-adfc1b1b71ed tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:18.731692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e212b6e-a4b8-4eeb-844d-adfc1b1b71ed tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:18.732851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e212b6e-a4b8-4eeb-844d-adfc1b1b71ed tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:18.735906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e212b6e-a4b8-4eeb-844d-adfc1b1b71ed tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:18.739106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e212b6e-a4b8-4eeb-844d-adfc1b1b71ed tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:18.769057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-078bdb8d-1a93-4716-bc4d-7443dac67db1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:18.769944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-078bdb8d-1a93-4716-bc4d-7443dac67db1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:18.780163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-078bdb8d-1a93-4716-bc4d-7443dac67db1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:18.780732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-078bdb8d-1a93-4716-bc4d-7443dac67db1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:18.781663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-078bdb8d-1a93-4716-bc4d-7443dac67db1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:18.782300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-078bdb8d-1a93-4716-bc4d-7443dac67db1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:19.106640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5e212b6e-a4b8-4eeb-844d-adfc1b1b71ed tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:19.117588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5e212b6e-a4b8-4eeb-844d-adfc1b1b71ed tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.399509 Dec 15 16:25:19.118757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 315/643] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:18 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:19.131440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-078bdb8d-1a93-4716-bc4d-7443dac67db1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:19.144236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-078bdb8d-1a93-4716-bc4d-7443dac67db1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1507 microversion: 2.1 time: 0.379277 Dec 15 16:25:19.156662 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 329/644] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:18 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:19.163765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a70cb834-bb3e-432b-adc4-168942a14e1d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aacb9a93-93b1-4b27-8b9e-9b044052d5e8", "device": "/dev/sdb"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:19.165335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a70cb834-bb3e-432b-adc4-168942a14e1d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:19.176499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a70cb834-bb3e-432b-adc4-168942a14e1d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:19.176961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a70cb834-bb3e-432b-adc4-168942a14e1d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:19.178009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a70cb834-bb3e-432b-adc4-168942a14e1d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:19.178619 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a70cb834-bb3e-432b-adc4-168942a14e1d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:19.303243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-9aa3f45a-2650-4731-9f48-51468bf04535 req-72cc7191-ba08-4dad-ad6a-7271e843a06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c741ad6-9157-4ba5-95bd-eeb9f72f6604", "tag": "58699787-5d74-4aaa-912a-e7264f21e0ca"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:19.307028 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:19.307028 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:25:19.315871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-9aa3f45a-2650-4731-9f48-51468bf04535 req-72cc7191-ba08-4dad-ad6a-7271e843a06e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:19.318236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-9aa3f45a-2650-4731-9f48-51468bf04535 req-72cc7191-ba08-4dad-ad6a-7271e843a06e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:19.356030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-9aa3f45a-2650-4731-9f48-51468bf04535 req-72cc7191-ba08-4dad-ad6a-7271e843a06e service nova] Creating event network-changed:58699787-5d74-4aaa-912a-e7264f21e0ca for instance 7c741ad6-9157-4ba5-95bd-eeb9f72f6604 on hv-cinder-82002 Dec 15 16:25:19.371979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-9aa3f45a-2650-4731-9f48-51468bf04535 req-72cc7191-ba08-4dad-ad6a-7271e843a06e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069795 Dec 15 16:25:19.373359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 330/645] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:25:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:25:19.530581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a70cb834-bb3e-432b-adc4-168942a14e1d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "POST /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371512 Dec 15 16:25:19.534038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 316/646] 10.222.0.30 () {60 vars in 1322 bytes} [Wed Dec 15 16:25:19 2021] POST /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:20.139104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cba2b83b-3274-4f1e-9784-a595264dcd1c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:20.141658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cba2b83b-3274-4f1e-9784-a595264dcd1c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:20.151892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cba2b83b-3274-4f1e-9784-a595264dcd1c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:20.152883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cba2b83b-3274-4f1e-9784-a595264dcd1c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:20.153923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cba2b83b-3274-4f1e-9784-a595264dcd1c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:20.154553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cba2b83b-3274-4f1e-9784-a595264dcd1c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:20.794949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cba2b83b-3274-4f1e-9784-a595264dcd1c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:20.802761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cba2b83b-3274-4f1e-9784-a595264dcd1c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.669442 Dec 15 16:25:20.806786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 331/647] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:20 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:21.825103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eedf154c-1e6e-4917-8ef4-3b57e61215e9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:21.826412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eedf154c-1e6e-4917-8ef4-3b57e61215e9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:21.843269 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eedf154c-1e6e-4917-8ef4-3b57e61215e9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:21.844728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eedf154c-1e6e-4917-8ef4-3b57e61215e9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:21.850996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eedf154c-1e6e-4917-8ef4-3b57e61215e9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:21.851641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eedf154c-1e6e-4917-8ef4-3b57e61215e9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:22.223802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eedf154c-1e6e-4917-8ef4-3b57e61215e9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:22.237103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eedf154c-1e6e-4917-8ef4-3b57e61215e9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.416576 Dec 15 16:25:22.238790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 317/648] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:21 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:23.258211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cc1fcf18-9799-4627-b148-cf0e59fcf7a0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:23.259682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cc1fcf18-9799-4627-b148-cf0e59fcf7a0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:23.269379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cc1fcf18-9799-4627-b148-cf0e59fcf7a0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:23.270057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cc1fcf18-9799-4627-b148-cf0e59fcf7a0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:23.271047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cc1fcf18-9799-4627-b148-cf0e59fcf7a0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:23.271655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cc1fcf18-9799-4627-b148-cf0e59fcf7a0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:23.543887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cc1fcf18-9799-4627-b148-cf0e59fcf7a0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:23.552777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cc1fcf18-9799-4627-b148-cf0e59fcf7a0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.301218 Dec 15 16:25:23.554106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 332/649] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:23 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:24.571165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0671a410-5c4c-4924-8d31-63f3241c47d4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:24.573513 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0671a410-5c4c-4924-8d31-63f3241c47d4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:24.581049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0671a410-5c4c-4924-8d31-63f3241c47d4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:24.581493 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0671a410-5c4c-4924-8d31-63f3241c47d4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:24.582505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0671a410-5c4c-4924-8d31-63f3241c47d4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:24.582942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0671a410-5c4c-4924-8d31-63f3241c47d4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:24.789052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0671a410-5c4c-4924-8d31-63f3241c47d4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:24.801868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0671a410-5c4c-4924-8d31-63f3241c47d4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.234241 Dec 15 16:25:24.809479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 318/650] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:24 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:25.826130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f5d0210f-c9ea-4a7d-9f2d-45ddb7615860 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:25.826952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f5d0210f-c9ea-4a7d-9f2d-45ddb7615860 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:25.833843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5d0210f-c9ea-4a7d-9f2d-45ddb7615860 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:25.834760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5d0210f-c9ea-4a7d-9f2d-45ddb7615860 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:25.835975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5d0210f-c9ea-4a7d-9f2d-45ddb7615860 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:25.836702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5d0210f-c9ea-4a7d-9f2d-45ddb7615860 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:26.031222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f5d0210f-c9ea-4a7d-9f2d-45ddb7615860 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:26.043451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f5d0210f-c9ea-4a7d-9f2d-45ddb7615860 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.221561 Dec 15 16:25:26.056796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 333/651] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:25 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:27.064012 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a30c303d-5260-4736-9397-25a55a12ddae tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:27.065025 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a30c303d-5260-4736-9397-25a55a12ddae tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:27.073355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a30c303d-5260-4736-9397-25a55a12ddae tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:27.074093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a30c303d-5260-4736-9397-25a55a12ddae tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:27.075880 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a30c303d-5260-4736-9397-25a55a12ddae tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:27.076314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a30c303d-5260-4736-9397-25a55a12ddae tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:27.254523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a30c303d-5260-4736-9397-25a55a12ddae tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:27.266534 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a30c303d-5260-4736-9397-25a55a12ddae tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.206217 Dec 15 16:25:27.267426 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 319/652] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:27 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:28.286304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-85b19a85-8936-4b9e-8941-5b5c17a79f16 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:28.287954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-85b19a85-8936-4b9e-8941-5b5c17a79f16 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:28.322872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85b19a85-8936-4b9e-8941-5b5c17a79f16 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:28.324400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85b19a85-8936-4b9e-8941-5b5c17a79f16 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:28.325527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85b19a85-8936-4b9e-8941-5b5c17a79f16 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:28.327200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85b19a85-8936-4b9e-8941-5b5c17a79f16 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:28.554498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-85b19a85-8936-4b9e-8941-5b5c17a79f16 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:28.562857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-85b19a85-8936-4b9e-8941-5b5c17a79f16 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.281942 Dec 15 16:25:28.564003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 334/653] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:28 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:29.299211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-be67843a-03f7-4e8d-b88e-ad8775559b13 req-304c7832-3e1b-41dd-bd93-10257282ac8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c741ad6-9157-4ba5-95bd-eeb9f72f6604", "name": "network-vif-plugged", "status": "completed", "tag": "58699787-5d74-4aaa-912a-e7264f21e0ca"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:29.301733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:29.301733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:25:29.311593 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-be67843a-03f7-4e8d-b88e-ad8775559b13 req-304c7832-3e1b-41dd-bd93-10257282ac8d service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:29.312572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-be67843a-03f7-4e8d-b88e-ad8775559b13 req-304c7832-3e1b-41dd-bd93-10257282ac8d service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:29.335904 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-be67843a-03f7-4e8d-b88e-ad8775559b13 req-304c7832-3e1b-41dd-bd93-10257282ac8d service nova] Creating event network-vif-plugged:58699787-5d74-4aaa-912a-e7264f21e0ca for instance 7c741ad6-9157-4ba5-95bd-eeb9f72f6604 on hv-cinder-82002 Dec 15 16:25:29.343839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-be67843a-03f7-4e8d-b88e-ad8775559b13 req-304c7832-3e1b-41dd-bd93-10257282ac8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055445 Dec 15 16:25:29.346480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 320/654] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:25:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:29.582549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ceb6d654-4e99-4b23-bc98-8a0b144c1110 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:29.584529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ceb6d654-4e99-4b23-bc98-8a0b144c1110 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:29.594814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ceb6d654-4e99-4b23-bc98-8a0b144c1110 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:29.595815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ceb6d654-4e99-4b23-bc98-8a0b144c1110 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:29.597425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ceb6d654-4e99-4b23-bc98-8a0b144c1110 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:29.598452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ceb6d654-4e99-4b23-bc98-8a0b144c1110 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:29.851222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ceb6d654-4e99-4b23-bc98-8a0b144c1110 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:29.862813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ceb6d654-4e99-4b23-bc98-8a0b144c1110 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.284021 Dec 15 16:25:29.864408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 335/655] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:29 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:30.011587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7ea73aa7-ab19-4e7b-875c-be0102f6c7fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:30.011587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7ea73aa7-ab19-4e7b-875c-be0102f6c7fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:30.024081 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ea73aa7-ab19-4e7b-875c-be0102f6c7fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:30.024081 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ea73aa7-ab19-4e7b-875c-be0102f6c7fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:30.024081 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ea73aa7-ab19-4e7b-875c-be0102f6c7fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:30.024081 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ea73aa7-ab19-4e7b-875c-be0102f6c7fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:30.149489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-7ea73aa7-ab19-4e7b-875c-be0102f6c7fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lazy-loading 'services' on Instance uuid 58544761-395a-4b54-876b-38750b3d8cf1 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:25:30.262289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7ea73aa7-ab19-4e7b-875c-be0102f6c7fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "DELETE /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments/0ddcbbd6-77a3-40fe-ba9f-2424d44f9bd6" status: 202 len: 0 microversion: 2.1 time: 0.262407 Dec 15 16:25:30.262963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 321/656] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Dec 15 16:25:29 2021] DELETE /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments/0ddcbbd6-77a3-40fe-ba9f-2424d44f9bd6 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:30.886332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-978ceb97-c359-4970-ac85-37413b21cf5e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:30.889498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-978ceb97-c359-4970-ac85-37413b21cf5e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:30.902452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-978ceb97-c359-4970-ac85-37413b21cf5e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:30.903244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-978ceb97-c359-4970-ac85-37413b21cf5e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:30.904945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-978ceb97-c359-4970-ac85-37413b21cf5e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:30.905366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-978ceb97-c359-4970-ac85-37413b21cf5e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:31.080953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-978ceb97-c359-4970-ac85-37413b21cf5e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:31.090115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-978ceb97-c359-4970-ac85-37413b21cf5e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.208456 Dec 15 16:25:31.090944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 336/657] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:30 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:32.110137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a92258f8-eda2-4d59-8dce-2af61fd12d5d tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:32.110955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a92258f8-eda2-4d59-8dce-2af61fd12d5d tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:32.120943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a92258f8-eda2-4d59-8dce-2af61fd12d5d tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:32.124299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a92258f8-eda2-4d59-8dce-2af61fd12d5d tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:32.125294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a92258f8-eda2-4d59-8dce-2af61fd12d5d tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:32.125809 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a92258f8-eda2-4d59-8dce-2af61fd12d5d tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:32.283045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a92258f8-eda2-4d59-8dce-2af61fd12d5d tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:32.302256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a92258f8-eda2-4d59-8dce-2af61fd12d5d tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1317 microversion: 2.1 time: 0.198304 Dec 15 16:25:32.304479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 322/658] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:32 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:33.322847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5c07acf3-b3f2-46c7-bf89-598f70abd74c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:33.324269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5c07acf3-b3f2-46c7-bf89-598f70abd74c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:33.330492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c07acf3-b3f2-46c7-bf89-598f70abd74c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:33.331198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c07acf3-b3f2-46c7-bf89-598f70abd74c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:33.332190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c07acf3-b3f2-46c7-bf89-598f70abd74c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:33.332649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c07acf3-b3f2-46c7-bf89-598f70abd74c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:33.478071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5c07acf3-b3f2-46c7-bf89-598f70abd74c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:33.486504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5c07acf3-b3f2-46c7-bf89-598f70abd74c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1507 microversion: 2.1 time: 0.167530 Dec 15 16:25:33.487621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 337/659] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:33 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:34.397087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-14e0398c-289f-452e-a28e-903ae48eaaf1 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Action: 'create', calling method: .version_select at 0x7f3a7c1a8ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1408138682"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:34.412696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-14e0398c-289f-452e-a28e-903ae48eaaf1 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Getting quotas for project f522fcfc9fef4de1ba79e2f5a416ecff. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:25:34.417698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-14e0398c-289f-452e-a28e-903ae48eaaf1 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Getting quotas for user 9227cd2569074a6cbae4066c7650ea9f and project f522fcfc9fef4de1ba79e2f5a416ecff. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:25:34.795307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-14e0398c-289f-452e-a28e-903ae48eaaf1 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Getting quotas for project f522fcfc9fef4de1ba79e2f5a416ecff. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:25:34.800595 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-14e0398c-289f-452e-a28e-903ae48eaaf1 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Getting quotas for user 9227cd2569074a6cbae4066c7650ea9f and project f522fcfc9fef4de1ba79e2f5a416ecff. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:25:34.817762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-14e0398c-289f-452e-a28e-903ae48eaaf1 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.424363 Dec 15 16:25:34.818367 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 323/660] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Dec 15 16:25:34 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:34.879344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1679458103", "imageRef": "5566df3e-d77b-4de8-b876-6ea1dd6246f8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1408138682", "networks": [{"uuid": "98677a4a-2273-47c4-9e09-91a787c81fe0"}]}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:34.930157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.network.neutron [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] validate_networks() for [('98677a4a-2273-47c4-9e09-91a787c81fe0', None, None, None, None, None)] {{(pid=116021) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:25:35.327067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Flavor limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:25:35.327498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Image limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:25:35.328004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Flavor pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:25:35.328411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Image pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:25:35.328831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:25:35.340232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:35.340932 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:35.342250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:35.342893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:35.364265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Getting quotas for project f522fcfc9fef4de1ba79e2f5a416ecff. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:25:35.368469 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Getting quotas for user 9227cd2569074a6cbae4066c7650ea9f and project f522fcfc9fef4de1ba79e2f5a416ecff. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:25:35.379987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Going to run 1 instances... {{(pid=116021) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:25:35.382334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5566df3e-d77b-4de8-b876-6ea1dd6246f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:25:35.428813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bfe10959-f6da-4922-8df5-997c1bbcaafb tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552788 Dec 15 16:25:35.429459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 338/661] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:25:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:25:35.439935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fccdcca3-dd5c-494d-8311-66fee18b28b9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:35.440693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fccdcca3-dd5c-494d-8311-66fee18b28b9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:35.494114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fccdcca3-dd5c-494d-8311-66fee18b28b9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:35.501766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fccdcca3-dd5c-494d-8311-66fee18b28b9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1259 microversion: 2.1 time: 0.066059 Dec 15 16:25:35.502359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 324/662] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:35 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:36.519763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-228c9da3-2b08-4492-9254-f29c32bbda36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:36.520309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-228c9da3-2b08-4492-9254-f29c32bbda36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:36.528371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-228c9da3-2b08-4492-9254-f29c32bbda36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:36.528898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-228c9da3-2b08-4492-9254-f29c32bbda36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:36.529680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-228c9da3-2b08-4492-9254-f29c32bbda36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:36.530136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-228c9da3-2b08-4492-9254-f29c32bbda36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:36.628391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-228c9da3-2b08-4492-9254-f29c32bbda36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:36.636558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-228c9da3-2b08-4492-9254-f29c32bbda36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1319 microversion: 2.1 time: 0.120694 Dec 15 16:25:36.637401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 339/663] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:36 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1319 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:37.654815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4eb4bd6d-be8d-4ceb-bdb8-42231a565d36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:37.655538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4eb4bd6d-be8d-4ceb-bdb8-42231a565d36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:37.662928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4eb4bd6d-be8d-4ceb-bdb8-42231a565d36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:37.663267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4eb4bd6d-be8d-4ceb-bdb8-42231a565d36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:37.664284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4eb4bd6d-be8d-4ceb-bdb8-42231a565d36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:37.665041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4eb4bd6d-be8d-4ceb-bdb8-42231a565d36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:37.801718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4eb4bd6d-be8d-4ceb-bdb8-42231a565d36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:37.809842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4eb4bd6d-be8d-4ceb-bdb8-42231a565d36 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.159099 Dec 15 16:25:37.810405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 325/664] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:37 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:38.829481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-26e4c4e2-8a35-4645-ab4d-af41660600f4 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:38.830127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-26e4c4e2-8a35-4645-ab4d-af41660600f4 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:38.836785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26e4c4e2-8a35-4645-ab4d-af41660600f4 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:38.837389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26e4c4e2-8a35-4645-ab4d-af41660600f4 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:38.838237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26e4c4e2-8a35-4645-ab4d-af41660600f4 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:38.838666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26e4c4e2-8a35-4645-ab4d-af41660600f4 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:38.980088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-26e4c4e2-8a35-4645-ab4d-af41660600f4 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:38.988994 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-26e4c4e2-8a35-4645-ab4d-af41660600f4 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.165099 Dec 15 16:25:38.989774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 340/665] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:38 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:40.006400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4a82d8d4-de7a-4b2f-8a1f-cc6f0c72170f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:40.007077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4a82d8d4-de7a-4b2f-8a1f-cc6f0c72170f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:40.023098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a82d8d4-de7a-4b2f-8a1f-cc6f0c72170f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:40.023547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a82d8d4-de7a-4b2f-8a1f-cc6f0c72170f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:40.024408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a82d8d4-de7a-4b2f-8a1f-cc6f0c72170f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:40.024842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a82d8d4-de7a-4b2f-8a1f-cc6f0c72170f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:40.160911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4a82d8d4-de7a-4b2f-8a1f-cc6f0c72170f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:40.169345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4a82d8d4-de7a-4b2f-8a1f-cc6f0c72170f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.166583 Dec 15 16:25:40.169967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 326/666] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:40 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:41.188189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5dc6d498-412f-434f-b7ca-a9de10140726 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:41.188971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5dc6d498-412f-434f-b7ca-a9de10140726 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:41.195909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5dc6d498-412f-434f-b7ca-a9de10140726 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:41.196359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5dc6d498-412f-434f-b7ca-a9de10140726 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:41.197165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5dc6d498-412f-434f-b7ca-a9de10140726 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:41.197604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5dc6d498-412f-434f-b7ca-a9de10140726 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:41.343509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5dc6d498-412f-434f-b7ca-a9de10140726 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:41.351359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5dc6d498-412f-434f-b7ca-a9de10140726 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.168041 Dec 15 16:25:41.351936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 341/667] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:41 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:42.371794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-26139fb5-9700-478c-ac5d-92d7781cf725 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:42.373045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-26139fb5-9700-478c-ac5d-92d7781cf725 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:42.380228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26139fb5-9700-478c-ac5d-92d7781cf725 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:42.380700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26139fb5-9700-478c-ac5d-92d7781cf725 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:42.381492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26139fb5-9700-478c-ac5d-92d7781cf725 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:42.381924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26139fb5-9700-478c-ac5d-92d7781cf725 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:42.525547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-26139fb5-9700-478c-ac5d-92d7781cf725 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:42.533672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-26139fb5-9700-478c-ac5d-92d7781cf725 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.167298 Dec 15 16:25:42.535138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 327/668] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:42 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:42.953316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:25:42.953316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:25:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:25:43.552132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ea764b48-34bf-47a3-aed2-4e16db4af087 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:43.553286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ea764b48-34bf-47a3-aed2-4e16db4af087 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:43.561466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ea764b48-34bf-47a3-aed2-4e16db4af087 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:43.561879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ea764b48-34bf-47a3-aed2-4e16db4af087 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:43.563007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ea764b48-34bf-47a3-aed2-4e16db4af087 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:43.563754 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ea764b48-34bf-47a3-aed2-4e16db4af087 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:43.708271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ea764b48-34bf-47a3-aed2-4e16db4af087 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:43.716990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ea764b48-34bf-47a3-aed2-4e16db4af087 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.169075 Dec 15 16:25:43.717752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 342/669] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:43 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:44.735176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cdb6b44d-4919-41cd-9679-808fddc1ebf5 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:44.735857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cdb6b44d-4919-41cd-9679-808fddc1ebf5 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:44.743744 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cdb6b44d-4919-41cd-9679-808fddc1ebf5 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:44.744187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cdb6b44d-4919-41cd-9679-808fddc1ebf5 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:44.745414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cdb6b44d-4919-41cd-9679-808fddc1ebf5 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:44.745515 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cdb6b44d-4919-41cd-9679-808fddc1ebf5 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:44.885830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cdb6b44d-4919-41cd-9679-808fddc1ebf5 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:44.894128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cdb6b44d-4919-41cd-9679-808fddc1ebf5 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.162689 Dec 15 16:25:44.894714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 328/670] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:44 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:45.911895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9859d053-142e-4cf4-acc2-beff22577679 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:45.912758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9859d053-142e-4cf4-acc2-beff22577679 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:45.919427 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9859d053-142e-4cf4-acc2-beff22577679 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:45.919911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9859d053-142e-4cf4-acc2-beff22577679 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:45.920715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9859d053-142e-4cf4-acc2-beff22577679 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:45.921141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9859d053-142e-4cf4-acc2-beff22577679 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:46.222980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9859d053-142e-4cf4-acc2-beff22577679 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:46.231013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9859d053-142e-4cf4-acc2-beff22577679 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.323234 Dec 15 16:25:46.240116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 343/671] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:45 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:47.249566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aea81b72-9c31-4e92-b5ed-ce6c57815c1a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:47.250325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aea81b72-9c31-4e92-b5ed-ce6c57815c1a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:47.258894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aea81b72-9c31-4e92-b5ed-ce6c57815c1a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:47.259381 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aea81b72-9c31-4e92-b5ed-ce6c57815c1a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:47.260284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aea81b72-9c31-4e92-b5ed-ce6c57815c1a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:47.260935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aea81b72-9c31-4e92-b5ed-ce6c57815c1a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:47.475909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aea81b72-9c31-4e92-b5ed-ce6c57815c1a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:47.483568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aea81b72-9c31-4e92-b5ed-ce6c57815c1a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.238822 Dec 15 16:25:47.484565 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 329/672] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:47 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:48.503592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7fe49e8e-8e64-47b2-a6e8-f68098af895f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:48.504213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7fe49e8e-8e64-47b2-a6e8-f68098af895f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:48.510901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7fe49e8e-8e64-47b2-a6e8-f68098af895f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:48.511425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7fe49e8e-8e64-47b2-a6e8-f68098af895f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:48.512465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7fe49e8e-8e64-47b2-a6e8-f68098af895f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:48.512904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7fe49e8e-8e64-47b2-a6e8-f68098af895f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:48.662938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7fe49e8e-8e64-47b2-a6e8-f68098af895f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:48.675623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7fe49e8e-8e64-47b2-a6e8-f68098af895f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.177317 Dec 15 16:25:48.680286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 344/673] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:48 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:49.699899 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c835a463-0324-4cfe-8460-ee97036e9e9a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:49.700701 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c835a463-0324-4cfe-8460-ee97036e9e9a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:49.707931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c835a463-0324-4cfe-8460-ee97036e9e9a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:49.708374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c835a463-0324-4cfe-8460-ee97036e9e9a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:49.709190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c835a463-0324-4cfe-8460-ee97036e9e9a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:49.709614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c835a463-0324-4cfe-8460-ee97036e9e9a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:49.847793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c835a463-0324-4cfe-8460-ee97036e9e9a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:49.855347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c835a463-0324-4cfe-8460-ee97036e9e9a tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.160822 Dec 15 16:25:49.855939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 330/674] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:49 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:50.613785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bc750ea6-31ad-4543-9b80-1f154b361a73 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:50.616165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bc750ea6-31ad-4543-9b80-1f154b361a73 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:50.628291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc750ea6-31ad-4543-9b80-1f154b361a73 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:50.629044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc750ea6-31ad-4543-9b80-1f154b361a73 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:50.630293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc750ea6-31ad-4543-9b80-1f154b361a73 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:50.630959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc750ea6-31ad-4543-9b80-1f154b361a73 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:50.671634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bc750ea6-31ad-4543-9b80-1f154b361a73 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments/e4276f5f-7069-4ad3-8bbd-063936d4d3b5" status: 200 len: 194 microversion: 2.20 time: 0.065850 Dec 15 16:25:50.678309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 345/675] 10.222.0.30 () {60 vars in 1453 bytes} [Wed Dec 15 16:25:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments/e4276f5f-7069-4ad3-8bbd-063936d4d3b5 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:25:50.777946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-79f095cc-b7f2-43d9-b00d-7ea0a50c485e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:50.779227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-79f095cc-b7f2-43d9-b00d-7ea0a50c485e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:50.786307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79f095cc-b7f2-43d9-b00d-7ea0a50c485e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:50.787193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79f095cc-b7f2-43d9-b00d-7ea0a50c485e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:50.788042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79f095cc-b7f2-43d9-b00d-7ea0a50c485e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:50.788513 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79f095cc-b7f2-43d9-b00d-7ea0a50c485e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:50.872912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-2a0ef0f0-e4e2-4c49-9f66-83a99ac9626b req-63643381-27d4-43da-8656-75819f4e7a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f742b3a2-5ed6-447e-ba04-f3ecae760884", "tag": "91109cf4-86ff-4b71-9582-363431f8e06c"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:50.873877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-79f095cc-b7f2-43d9-b00d-7ea0a50c485e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lazy-loading 'services' on Instance uuid 134cc886-afce-4a89-b875-cdf6768bfd8f {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:25:50.880420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:50.880420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:25:50.898802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-2a0ef0f0-e4e2-4c49-9f66-83a99ac9626b req-63643381-27d4-43da-8656-75819f4e7a05 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:50.899252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-2a0ef0f0-e4e2-4c49-9f66-83a99ac9626b req-63643381-27d4-43da-8656-75819f4e7a05 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:50.920898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-2a0ef0f0-e4e2-4c49-9f66-83a99ac9626b req-63643381-27d4-43da-8656-75819f4e7a05 service nova] Creating event network-changed:91109cf4-86ff-4b71-9582-363431f8e06c for instance f742b3a2-5ed6-447e-ba04-f3ecae760884 on hv-cinder-82002 Dec 15 16:25:50.931327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-2a0ef0f0-e4e2-4c49-9f66-83a99ac9626b req-63643381-27d4-43da-8656-75819f4e7a05 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066115 Dec 15 16:25:50.932495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 346/676] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:25:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:50.938617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-23d38082-c9a3-4105-ad11-a2d8a3794f4c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:50.939577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-23d38082-c9a3-4105-ad11-a2d8a3794f4c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:50.946764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23d38082-c9a3-4105-ad11-a2d8a3794f4c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:50.947214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23d38082-c9a3-4105-ad11-a2d8a3794f4c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:50.948041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23d38082-c9a3-4105-ad11-a2d8a3794f4c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:50.948469 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23d38082-c9a3-4105-ad11-a2d8a3794f4c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:50.988777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-79f095cc-b7f2-43d9-b00d-7ea0a50c485e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "DELETE /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments/e4276f5f-7069-4ad3-8bbd-063936d4d3b5" status: 202 len: 0 microversion: 2.20 time: 0.213648 Dec 15 16:25:50.990347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 331/677] 10.222.0.30 () {60 vars in 1456 bytes} [Wed Dec 15 16:25:50 2021] DELETE /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments/e4276f5f-7069-4ad3-8bbd-063936d4d3b5 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:25:51.004242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a4d87590-788d-4693-8993-65d3c00b3978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:51.006108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a4d87590-788d-4693-8993-65d3c00b3978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:51.020144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4d87590-788d-4693-8993-65d3c00b3978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:51.020682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4d87590-788d-4693-8993-65d3c00b3978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:51.021808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4d87590-788d-4693-8993-65d3c00b3978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:51.022452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4d87590-788d-4693-8993-65d3c00b3978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:51.064007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a4d87590-788d-4693-8993-65d3c00b3978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068309 Dec 15 16:25:51.064739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 332/678] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:25:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:25:51.205957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-23d38082-c9a3-4105-ad11-a2d8a3794f4c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:51.214209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-23d38082-c9a3-4105-ad11-a2d8a3794f4c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.280339 Dec 15 16:25:51.214785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 347/679] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:50 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:52.077263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-03d97055-e07b-467f-b73c-a8cb3c5414fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:52.078177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-03d97055-e07b-467f-b73c-a8cb3c5414fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:52.085195 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-03d97055-e07b-467f-b73c-a8cb3c5414fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:52.085642 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-03d97055-e07b-467f-b73c-a8cb3c5414fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:52.086439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-03d97055-e07b-467f-b73c-a8cb3c5414fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:52.086865 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-03d97055-e07b-467f-b73c-a8cb3c5414fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:52.117729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-03d97055-e07b-467f-b73c-a8cb3c5414fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044320 Dec 15 16:25:52.118319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 333/680] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:25:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:25:52.233222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2994af2d-f53f-4d0e-813a-9aab6b08ed79 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:52.234098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2994af2d-f53f-4d0e-813a-9aab6b08ed79 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:52.243336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2994af2d-f53f-4d0e-813a-9aab6b08ed79 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:52.243955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2994af2d-f53f-4d0e-813a-9aab6b08ed79 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:52.245085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2994af2d-f53f-4d0e-813a-9aab6b08ed79 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:52.245660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2994af2d-f53f-4d0e-813a-9aab6b08ed79 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:52.405653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2994af2d-f53f-4d0e-813a-9aab6b08ed79 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:52.417046 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2994af2d-f53f-4d0e-813a-9aab6b08ed79 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.188580 Dec 15 16:25:52.417752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 348/681] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:52 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:53.130155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3073054c-6876-4915-a0bf-503ba87e4cfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:53.131078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3073054c-6876-4915-a0bf-503ba87e4cfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:53.137858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3073054c-6876-4915-a0bf-503ba87e4cfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:53.138287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3073054c-6876-4915-a0bf-503ba87e4cfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:53.139077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3073054c-6876-4915-a0bf-503ba87e4cfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:53.139507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3073054c-6876-4915-a0bf-503ba87e4cfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:53.172076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3073054c-6876-4915-a0bf-503ba87e4cfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046145 Dec 15 16:25:53.172719 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 334/682] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:25:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:25:53.437814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-184d7a21-08eb-41c3-9372-10b7f0a0fe8c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:53.438395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-184d7a21-08eb-41c3-9372-10b7f0a0fe8c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:53.445394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-184d7a21-08eb-41c3-9372-10b7f0a0fe8c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:53.445842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-184d7a21-08eb-41c3-9372-10b7f0a0fe8c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:53.446642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-184d7a21-08eb-41c3-9372-10b7f0a0fe8c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:53.447056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-184d7a21-08eb-41c3-9372-10b7f0a0fe8c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:53.597982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-184d7a21-08eb-41c3-9372-10b7f0a0fe8c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:53.605777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-184d7a21-08eb-41c3-9372-10b7f0a0fe8c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.171768 Dec 15 16:25:53.606353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 349/683] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:53 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:54.184399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e44e86e7-d683-4bf0-8811-9b9739f764e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:54.185440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e44e86e7-d683-4bf0-8811-9b9739f764e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:54.192647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e44e86e7-d683-4bf0-8811-9b9739f764e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:54.193065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e44e86e7-d683-4bf0-8811-9b9739f764e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:54.193888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e44e86e7-d683-4bf0-8811-9b9739f764e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:54.194320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e44e86e7-d683-4bf0-8811-9b9739f764e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:54.226762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e44e86e7-d683-4bf0-8811-9b9739f764e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046432 Dec 15 16:25:54.227347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 335/684] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:25:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:25:54.623508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-95b96581-2333-40b8-8015-ff9473cb28f9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:54.624088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-95b96581-2333-40b8-8015-ff9473cb28f9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:54.630648 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95b96581-2333-40b8-8015-ff9473cb28f9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:54.631111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95b96581-2333-40b8-8015-ff9473cb28f9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:54.631888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95b96581-2333-40b8-8015-ff9473cb28f9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:54.632312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95b96581-2333-40b8-8015-ff9473cb28f9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:54.767635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-95b96581-2333-40b8-8015-ff9473cb28f9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:54.775858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-95b96581-2333-40b8-8015-ff9473cb28f9 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.156295 Dec 15 16:25:54.776415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 350/685] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:54 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:55.239850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9bf53f81-3807-4d7e-823e-53b1893c0dc6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:55.240788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9bf53f81-3807-4d7e-823e-53b1893c0dc6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:55.247404 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9bf53f81-3807-4d7e-823e-53b1893c0dc6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:55.247849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9bf53f81-3807-4d7e-823e-53b1893c0dc6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:55.248674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9bf53f81-3807-4d7e-823e-53b1893c0dc6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:55.249107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9bf53f81-3807-4d7e-823e-53b1893c0dc6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:55.279980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9bf53f81-3807-4d7e-823e-53b1893c0dc6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044441 Dec 15 16:25:55.280558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 336/686] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:25:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:25:55.795202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-406568cb-4975-4bdc-abce-cfaf2619588c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:55.796160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-406568cb-4975-4bdc-abce-cfaf2619588c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:55.810893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-406568cb-4975-4bdc-abce-cfaf2619588c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:55.811315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-406568cb-4975-4bdc-abce-cfaf2619588c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:55.812126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-406568cb-4975-4bdc-abce-cfaf2619588c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:55.812593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-406568cb-4975-4bdc-abce-cfaf2619588c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:55.968803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-406568cb-4975-4bdc-abce-cfaf2619588c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:55.979658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-406568cb-4975-4bdc-abce-cfaf2619588c tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.189935 Dec 15 16:25:55.980587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 351/687] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:55 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:56.292167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2b476960-3a90-4b2a-87cd-65be9e64c4dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:56.293298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2b476960-3a90-4b2a-87cd-65be9e64c4dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:56.301107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b476960-3a90-4b2a-87cd-65be9e64c4dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:56.301671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b476960-3a90-4b2a-87cd-65be9e64c4dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:56.302468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b476960-3a90-4b2a-87cd-65be9e64c4dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:56.302896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b476960-3a90-4b2a-87cd-65be9e64c4dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:56.333184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2b476960-3a90-4b2a-87cd-65be9e64c4dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044912 Dec 15 16:25:56.333764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 337/688] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:25:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:25:56.997486 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-15793c5b-4855-4e65-8f17-264c2ef49b94 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:56.998372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-15793c5b-4855-4e65-8f17-264c2ef49b94 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:57.008582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15793c5b-4855-4e65-8f17-264c2ef49b94 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:57.009236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15793c5b-4855-4e65-8f17-264c2ef49b94 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:57.012278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15793c5b-4855-4e65-8f17-264c2ef49b94 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:57.012775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15793c5b-4855-4e65-8f17-264c2ef49b94 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:57.171519 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-9c99267d-d0d4-4dc9-8f0b-2a97126df9be req-d25ea123-1c3b-4b1d-aeb6-f3b7fd0248a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f742b3a2-5ed6-447e-ba04-f3ecae760884", "name": "network-vif-plugged", "status": "completed", "tag": "91109cf4-86ff-4b71-9582-363431f8e06c"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:57.172552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-15793c5b-4855-4e65-8f17-264c2ef49b94 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:57.173311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:57.173311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:25:57.181216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-15793c5b-4855-4e65-8f17-264c2ef49b94 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.187364 Dec 15 16:25:57.182093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 352/689] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:56 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:57.183043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-9c99267d-d0d4-4dc9-8f0b-2a97126df9be req-d25ea123-1c3b-4b1d-aeb6-f3b7fd0248a2 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:57.183558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-9c99267d-d0d4-4dc9-8f0b-2a97126df9be req-d25ea123-1c3b-4b1d-aeb6-f3b7fd0248a2 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:57.196089 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-9c99267d-d0d4-4dc9-8f0b-2a97126df9be req-d25ea123-1c3b-4b1d-aeb6-f3b7fd0248a2 service nova] Creating event network-vif-plugged:91109cf4-86ff-4b71-9582-363431f8e06c for instance f742b3a2-5ed6-447e-ba04-f3ecae760884 on hv-cinder-82002 Dec 15 16:25:57.201070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-9c99267d-d0d4-4dc9-8f0b-2a97126df9be req-d25ea123-1c3b-4b1d-aeb6-f3b7fd0248a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034770 Dec 15 16:25:57.201791 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 338/690] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:25:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:57.345695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5c027a08-d00b-421b-8130-d7439fdecd24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:57.346839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5c027a08-d00b-421b-8130-d7439fdecd24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:57.353400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c027a08-d00b-421b-8130-d7439fdecd24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:57.354123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c027a08-d00b-421b-8130-d7439fdecd24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:57.354930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c027a08-d00b-421b-8130-d7439fdecd24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:57.355356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c027a08-d00b-421b-8130-d7439fdecd24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:57.389202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5c027a08-d00b-421b-8130-d7439fdecd24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047359 Dec 15 16:25:57.389804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 353/691] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:25:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:25:58.199961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dff1a70e-fb57-41b9-adf5-3a99ee32f7be tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:58.200702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dff1a70e-fb57-41b9-adf5-3a99ee32f7be tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:58.207145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dff1a70e-fb57-41b9-adf5-3a99ee32f7be tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:58.207590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dff1a70e-fb57-41b9-adf5-3a99ee32f7be tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:58.208363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dff1a70e-fb57-41b9-adf5-3a99ee32f7be tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:58.208823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dff1a70e-fb57-41b9-adf5-3a99ee32f7be tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:58.350045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dff1a70e-fb57-41b9-adf5-3a99ee32f7be tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:58.358577 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dff1a70e-fb57-41b9-adf5-3a99ee32f7be tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1359 microversion: 2.1 time: 0.163181 Dec 15 16:25:58.359161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 339/692] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:58 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:58.514219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aa35f6ad-e3b0-4b0d-babb-1b11793d2845 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:58.515162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aa35f6ad-e3b0-4b0d-babb-1b11793d2845 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:58.522063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa35f6ad-e3b0-4b0d-babb-1b11793d2845 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:58.522512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa35f6ad-e3b0-4b0d-babb-1b11793d2845 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:58.523293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa35f6ad-e3b0-4b0d-babb-1b11793d2845 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:58.523723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa35f6ad-e3b0-4b0d-babb-1b11793d2845 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:58.554575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aa35f6ad-e3b0-4b0d-babb-1b11793d2845 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.156770 Dec 15 16:25:58.555158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 354/693] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:25:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:25:59.381480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c1fc0136-0eb1-4a9e-a191-67b81f922ade tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:59.382051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c1fc0136-0eb1-4a9e-a191-67b81f922ade tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:59.389929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1fc0136-0eb1-4a9e-a191-67b81f922ade tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.390377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1fc0136-0eb1-4a9e-a191-67b81f922ade tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.391162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1fc0136-0eb1-4a9e-a191-67b81f922ade tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.391591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1fc0136-0eb1-4a9e-a191-67b81f922ade tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.527296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c1fc0136-0eb1-4a9e-a191-67b81f922ade tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:59.535461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c1fc0136-0eb1-4a9e-a191-67b81f922ade tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1550 microversion: 2.1 time: 0.159785 Dec 15 16:25:59.536046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 340/694] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:59 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:59.551428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-530762b3-6b76-43c2-9a17-a980aa3dc166 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:59.552062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-530762b3-6b76-43c2-9a17-a980aa3dc166 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:59.558593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-530762b3-6b76-43c2-9a17-a980aa3dc166 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.559038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-530762b3-6b76-43c2-9a17-a980aa3dc166 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.559848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-530762b3-6b76-43c2-9a17-a980aa3dc166 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.560266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-530762b3-6b76-43c2-9a17-a980aa3dc166 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.567498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ad9a410f-b087-45e8-9df3-48c8d169292e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:59.569117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ad9a410f-b087-45e8-9df3-48c8d169292e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:59.576321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad9a410f-b087-45e8-9df3-48c8d169292e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.576799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad9a410f-b087-45e8-9df3-48c8d169292e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.578308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad9a410f-b087-45e8-9df3-48c8d169292e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.578308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad9a410f-b087-45e8-9df3-48c8d169292e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.610508 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ad9a410f-b087-45e8-9df3-48c8d169292e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047816 Dec 15 16:25:59.611096 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 341/695] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:25:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:25:59.702676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-530762b3-6b76-43c2-9a17-a980aa3dc166 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:59.715548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-530762b3-6b76-43c2-9a17-a980aa3dc166 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1550 microversion: 2.1 time: 0.167488 Dec 15 16:25:59.716458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 355/696] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:59 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:59.733546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7fae4d76-936e-4638-ba53-5a288388163f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:59.736856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:59.736856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:25:59.738399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7fae4d76-936e-4638-ba53-5a288388163f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:59.739059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7fae4d76-936e-4638-ba53-5a288388163f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Searching by: {'deleted': False, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff'} {{(pid=116022) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 16:25:59.745977 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7fae4d76-936e-4638-ba53-5a288388163f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.746419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7fae4d76-936e-4638-ba53-5a288388163f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.747221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7fae4d76-936e-4638-ba53-5a288388163f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.747649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7fae4d76-936e-4638-ba53-5a288388163f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.836786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.multi_cell_list [None req-7fae4d76-936e-4638-ba53-5a288388163f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116022) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 16:25:59.933458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7fae4d76-936e-4638-ba53-5a288388163f tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203279 Dec 15 16:25:59.934139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 342/697] 10.222.0.30 () {58 vars in 1124 bytes} [Wed Dec 15 16:25:59 2021] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:59.945417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-26843a89-0046-4236-94df-809c1c248f8b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:59.946468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-26843a89-0046-4236-94df-809c1c248f8b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:59.953243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26843a89-0046-4236-94df-809c1c248f8b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.953707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26843a89-0046-4236-94df-809c1c248f8b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.954498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26843a89-0046-4236-94df-809c1c248f8b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:59.954918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26843a89-0046-4236-94df-809c1c248f8b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:00.089646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-26843a89-0046-4236-94df-809c1c248f8b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:00.097338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-26843a89-0046-4236-94df-809c1c248f8b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1550 microversion: 2.1 time: 0.155967 Dec 15 16:26:00.097950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 356/698] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:59 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:00.626686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7312dad6-5920-4cd7-9503-b4e43e0fe345 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:00.627903 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7312dad6-5920-4cd7-9503-b4e43e0fe345 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:00.634736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7312dad6-5920-4cd7-9503-b4e43e0fe345 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:00.635208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7312dad6-5920-4cd7-9503-b4e43e0fe345 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:00.636124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7312dad6-5920-4cd7-9503-b4e43e0fe345 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:00.636470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7312dad6-5920-4cd7-9503-b4e43e0fe345 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:00.669936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7312dad6-5920-4cd7-9503-b4e43e0fe345 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049471 Dec 15 16:26:00.670562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 343/699] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:01.684739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-509c6e0b-a46e-4709-b23c-c8feff12be59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:01.685731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-509c6e0b-a46e-4709-b23c-c8feff12be59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:01.695509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-509c6e0b-a46e-4709-b23c-c8feff12be59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:01.696126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-509c6e0b-a46e-4709-b23c-c8feff12be59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:01.697298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-509c6e0b-a46e-4709-b23c-c8feff12be59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:01.697954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-509c6e0b-a46e-4709-b23c-c8feff12be59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:01.730007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-509c6e0b-a46e-4709-b23c-c8feff12be59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051462 Dec 15 16:26:01.730547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 357/700] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:02.742655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d3e56fe1-48c5-4917-aa57-77f00c227cff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:02.743507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d3e56fe1-48c5-4917-aa57-77f00c227cff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:02.750401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3e56fe1-48c5-4917-aa57-77f00c227cff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:02.750826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3e56fe1-48c5-4917-aa57-77f00c227cff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:02.751636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3e56fe1-48c5-4917-aa57-77f00c227cff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:02.752066 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3e56fe1-48c5-4917-aa57-77f00c227cff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:02.785350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d3e56fe1-48c5-4917-aa57-77f00c227cff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046393 Dec 15 16:26:02.785997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 344/701] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:03.800371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-91faa3ce-e34c-40f6-ba70-5d9eb10f7605 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:03.801459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-91faa3ce-e34c-40f6-ba70-5d9eb10f7605 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:03.808232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91faa3ce-e34c-40f6-ba70-5d9eb10f7605 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:03.808705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91faa3ce-e34c-40f6-ba70-5d9eb10f7605 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:03.809487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91faa3ce-e34c-40f6-ba70-5d9eb10f7605 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:03.809916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91faa3ce-e34c-40f6-ba70-5d9eb10f7605 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:03.845260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-91faa3ce-e34c-40f6-ba70-5d9eb10f7605 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048933 Dec 15 16:26:03.845874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 358/702] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:04.858291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8bcdb252-fddf-4b4e-9b2f-2ad4c5cc8f38 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:04.859079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8bcdb252-fddf-4b4e-9b2f-2ad4c5cc8f38 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:04.866664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8bcdb252-fddf-4b4e-9b2f-2ad4c5cc8f38 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:04.867113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8bcdb252-fddf-4b4e-9b2f-2ad4c5cc8f38 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:04.867914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8bcdb252-fddf-4b4e-9b2f-2ad4c5cc8f38 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:04.868348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8bcdb252-fddf-4b4e-9b2f-2ad4c5cc8f38 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:04.901628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8bcdb252-fddf-4b4e-9b2f-2ad4c5cc8f38 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047282 Dec 15 16:26:04.902210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 345/703] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:05.913848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8a3e5a94-d7b3-4176-bab2-ca98dc9d7da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:05.914788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8a3e5a94-d7b3-4176-bab2-ca98dc9d7da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:05.921465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a3e5a94-d7b3-4176-bab2-ca98dc9d7da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:05.921890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a3e5a94-d7b3-4176-bab2-ca98dc9d7da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:05.922682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a3e5a94-d7b3-4176-bab2-ca98dc9d7da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:05.923146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a3e5a94-d7b3-4176-bab2-ca98dc9d7da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:05.955845 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8a3e5a94-d7b3-4176-bab2-ca98dc9d7da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045882 Dec 15 16:26:05.956696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 359/704] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:06.967630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3b94a727-883c-4f63-899a-6544a43c043b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:06.968538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3b94a727-883c-4f63-899a-6544a43c043b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:06.975980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3b94a727-883c-4f63-899a-6544a43c043b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:06.976464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3b94a727-883c-4f63-899a-6544a43c043b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:06.977283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3b94a727-883c-4f63-899a-6544a43c043b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:06.977701 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3b94a727-883c-4f63-899a-6544a43c043b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:07.010695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3b94a727-883c-4f63-899a-6544a43c043b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046949 Dec 15 16:26:07.011295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 346/705] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:08.023294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a9cc1a03-f1e5-47e6-a694-2121d17a207f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:08.024898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a9cc1a03-f1e5-47e6-a694-2121d17a207f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:08.032072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9cc1a03-f1e5-47e6-a694-2121d17a207f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:08.032547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9cc1a03-f1e5-47e6-a694-2121d17a207f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:08.033351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9cc1a03-f1e5-47e6-a694-2121d17a207f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:08.033779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9cc1a03-f1e5-47e6-a694-2121d17a207f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:08.068551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a9cc1a03-f1e5-47e6-a694-2121d17a207f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049656 Dec 15 16:26:08.069116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 360/706] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:09.080849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2db52df0-8726-420f-a4ea-cf76a4b28e00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:09.081732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2db52df0-8726-420f-a4ea-cf76a4b28e00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:09.088764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2db52df0-8726-420f-a4ea-cf76a4b28e00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:09.089213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2db52df0-8726-420f-a4ea-cf76a4b28e00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:09.089998 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2db52df0-8726-420f-a4ea-cf76a4b28e00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:09.090434 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2db52df0-8726-420f-a4ea-cf76a4b28e00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:09.122071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2db52df0-8726-420f-a4ea-cf76a4b28e00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045098 Dec 15 16:26:09.122662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 347/707] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:10.134580 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-de8aea1f-2b38-42cc-9277-ba778f89190c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:10.135457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-de8aea1f-2b38-42cc-9277-ba778f89190c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:10.142297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de8aea1f-2b38-42cc-9277-ba778f89190c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:10.142737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de8aea1f-2b38-42cc-9277-ba778f89190c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:10.143533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de8aea1f-2b38-42cc-9277-ba778f89190c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:10.143959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de8aea1f-2b38-42cc-9277-ba778f89190c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:10.176053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-de8aea1f-2b38-42cc-9277-ba778f89190c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045531 Dec 15 16:26:10.176679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 361/708] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:11.187722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f44e55a5-6a36-4c54-aae7-1d9ba57cb75d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:11.188572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f44e55a5-6a36-4c54-aae7-1d9ba57cb75d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:11.195709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f44e55a5-6a36-4c54-aae7-1d9ba57cb75d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:11.196155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f44e55a5-6a36-4c54-aae7-1d9ba57cb75d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:11.197011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f44e55a5-6a36-4c54-aae7-1d9ba57cb75d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:11.197454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f44e55a5-6a36-4c54-aae7-1d9ba57cb75d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:11.230262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f44e55a5-6a36-4c54-aae7-1d9ba57cb75d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046425 Dec 15 16:26:11.230847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 348/709] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:12.243316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2edf7435-92e5-4e79-b4cd-7022af97eabb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:12.244674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2edf7435-92e5-4e79-b4cd-7022af97eabb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:12.251841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2edf7435-92e5-4e79-b4cd-7022af97eabb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:12.252279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2edf7435-92e5-4e79-b4cd-7022af97eabb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:12.253119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2edf7435-92e5-4e79-b4cd-7022af97eabb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:12.253544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2edf7435-92e5-4e79-b4cd-7022af97eabb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:12.287579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2edf7435-92e5-4e79-b4cd-7022af97eabb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048548 Dec 15 16:26:12.288175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 362/710] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:13.302335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1db05443-6ba4-4a2d-bded-529737be4dc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:13.303251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1db05443-6ba4-4a2d-bded-529737be4dc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:13.310158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1db05443-6ba4-4a2d-bded-529737be4dc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:13.310603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1db05443-6ba4-4a2d-bded-529737be4dc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:13.311403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1db05443-6ba4-4a2d-bded-529737be4dc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:13.311834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1db05443-6ba4-4a2d-bded-529737be4dc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:13.359818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1db05443-6ba4-4a2d-bded-529737be4dc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062990 Dec 15 16:26:13.361294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 349/711] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:14.376539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2e1d4b6f-737d-4cef-85b5-4b190f23ef33 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:14.377513 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2e1d4b6f-737d-4cef-85b5-4b190f23ef33 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:14.384989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e1d4b6f-737d-4cef-85b5-4b190f23ef33 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:14.385426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e1d4b6f-737d-4cef-85b5-4b190f23ef33 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:14.386249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e1d4b6f-737d-4cef-85b5-4b190f23ef33 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:14.386684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e1d4b6f-737d-4cef-85b5-4b190f23ef33 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:14.420910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2e1d4b6f-737d-4cef-85b5-4b190f23ef33 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048290 Dec 15 16:26:14.421627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 363/712] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:15.436291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-25071e2a-7527-4df4-a5b2-704141aa96c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:15.437733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-25071e2a-7527-4df4-a5b2-704141aa96c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:15.447992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25071e2a-7527-4df4-a5b2-704141aa96c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:15.448496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25071e2a-7527-4df4-a5b2-704141aa96c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:15.449333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25071e2a-7527-4df4-a5b2-704141aa96c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:15.449760 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25071e2a-7527-4df4-a5b2-704141aa96c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:15.481857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-25071e2a-7527-4df4-a5b2-704141aa96c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051901 Dec 15 16:26:15.482469 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 350/713] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:16.498990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d4310ad4-ab94-4179-aaf8-4878370fc5c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:16.499964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d4310ad4-ab94-4179-aaf8-4878370fc5c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:16.509827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4310ad4-ab94-4179-aaf8-4878370fc5c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:16.510309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4310ad4-ab94-4179-aaf8-4878370fc5c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:16.511171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4310ad4-ab94-4179-aaf8-4878370fc5c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:16.511604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4310ad4-ab94-4179-aaf8-4878370fc5c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:16.549623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d4310ad4-ab94-4179-aaf8-4878370fc5c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054532 Dec 15 16:26:16.550308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 364/714] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:16 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:17.562242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c2b59219-cc3f-4912-b758-c509d212deeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:17.563168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c2b59219-cc3f-4912-b758-c509d212deeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:17.570803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c2b59219-cc3f-4912-b758-c509d212deeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:17.571248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c2b59219-cc3f-4912-b758-c509d212deeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:17.572050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c2b59219-cc3f-4912-b758-c509d212deeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:17.572489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c2b59219-cc3f-4912-b758-c509d212deeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:17.605639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c2b59219-cc3f-4912-b758-c509d212deeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047240 Dec 15 16:26:17.606248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 351/715] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:18.619736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3e712715-7e1e-499d-92bf-55f86089f39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:18.620697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3e712715-7e1e-499d-92bf-55f86089f39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:18.627775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e712715-7e1e-499d-92bf-55f86089f39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:18.628226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e712715-7e1e-499d-92bf-55f86089f39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:18.629061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e712715-7e1e-499d-92bf-55f86089f39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:18.630266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e712715-7e1e-499d-92bf-55f86089f39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:18.674920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3e712715-7e1e-499d-92bf-55f86089f39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060827 Dec 15 16:26:18.675501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 365/716] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:19.689810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-80ccdfc4-b9e7-4b9d-9a17-473e2854d0e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:19.689810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-80ccdfc4-b9e7-4b9d-9a17-473e2854d0e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:19.696677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80ccdfc4-b9e7-4b9d-9a17-473e2854d0e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:19.697125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80ccdfc4-b9e7-4b9d-9a17-473e2854d0e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:19.697956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80ccdfc4-b9e7-4b9d-9a17-473e2854d0e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:19.698387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80ccdfc4-b9e7-4b9d-9a17-473e2854d0e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:19.743369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-80ccdfc4-b9e7-4b9d-9a17-473e2854d0e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059832 Dec 15 16:26:19.744342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 352/717] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:20.755960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b707a49f-7bb7-4e5c-86eb-90a1fa72ec4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:20.756808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b707a49f-7bb7-4e5c-86eb-90a1fa72ec4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:20.763926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b707a49f-7bb7-4e5c-86eb-90a1fa72ec4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:20.764365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b707a49f-7bb7-4e5c-86eb-90a1fa72ec4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:20.765199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b707a49f-7bb7-4e5c-86eb-90a1fa72ec4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:20.765625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b707a49f-7bb7-4e5c-86eb-90a1fa72ec4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:20.797248 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b707a49f-7bb7-4e5c-86eb-90a1fa72ec4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045473 Dec 15 16:26:20.797898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 366/718] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:21.809800 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-55c3f184-07b7-4172-ba6b-c4b562e650d0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:21.811074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-55c3f184-07b7-4172-ba6b-c4b562e650d0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:21.818615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55c3f184-07b7-4172-ba6b-c4b562e650d0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:21.819151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55c3f184-07b7-4172-ba6b-c4b562e650d0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:21.820116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55c3f184-07b7-4172-ba6b-c4b562e650d0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:21.820705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55c3f184-07b7-4172-ba6b-c4b562e650d0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:21.867645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-55c3f184-07b7-4172-ba6b-c4b562e650d0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061742 Dec 15 16:26:21.868256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 353/719] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:26:22.880411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-39688843-30ab-4415-be16-a890b99cee7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:22.881432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-39688843-30ab-4415-be16-a890b99cee7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:22.888778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39688843-30ab-4415-be16-a890b99cee7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:22.889289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39688843-30ab-4415-be16-a890b99cee7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:22.890552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39688843-30ab-4415-be16-a890b99cee7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:22.891088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39688843-30ab-4415-be16-a890b99cee7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:22.925688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-39688843-30ab-4415-be16-a890b99cee7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049679 Dec 15 16:26:22.926298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 367/720] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:23.939810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ba36e5c3-a7a9-4604-8c6a-2a42d4adce19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:23.940947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ba36e5c3-a7a9-4604-8c6a-2a42d4adce19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:23.948836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba36e5c3-a7a9-4604-8c6a-2a42d4adce19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:23.949311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba36e5c3-a7a9-4604-8c6a-2a42d4adce19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:23.950168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba36e5c3-a7a9-4604-8c6a-2a42d4adce19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:23.950608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba36e5c3-a7a9-4604-8c6a-2a42d4adce19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:23.985248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ba36e5c3-a7a9-4604-8c6a-2a42d4adce19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049377 Dec 15 16:26:23.985847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 354/721] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:24.998158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-246be614-439b-494c-a2b3-23c62565ca3d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:24.998970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-246be614-439b-494c-a2b3-23c62565ca3d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:25.006553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-246be614-439b-494c-a2b3-23c62565ca3d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:25.006996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-246be614-439b-494c-a2b3-23c62565ca3d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:25.007812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-246be614-439b-494c-a2b3-23c62565ca3d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:25.008236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-246be614-439b-494c-a2b3-23c62565ca3d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:25.041970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-246be614-439b-494c-a2b3-23c62565ca3d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047575 Dec 15 16:26:25.042815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 368/722] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:26.054999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cfa90edd-ab00-4932-85eb-5170e376d29f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:26.055905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cfa90edd-ab00-4932-85eb-5170e376d29f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:26.063031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cfa90edd-ab00-4932-85eb-5170e376d29f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:26.063471 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cfa90edd-ab00-4932-85eb-5170e376d29f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:26.064272 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cfa90edd-ab00-4932-85eb-5170e376d29f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:26.064738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cfa90edd-ab00-4932-85eb-5170e376d29f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:26.098141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cfa90edd-ab00-4932-85eb-5170e376d29f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047317 Dec 15 16:26:26.098848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 355/723] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:26:27.111052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a597b18f-34e6-4efb-b0e9-ee5c39c8a3d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:27.111951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a597b18f-34e6-4efb-b0e9-ee5c39c8a3d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:27.120196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a597b18f-34e6-4efb-b0e9-ee5c39c8a3d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:27.120674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a597b18f-34e6-4efb-b0e9-ee5c39c8a3d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:27.121478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a597b18f-34e6-4efb-b0e9-ee5c39c8a3d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:27.121912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a597b18f-34e6-4efb-b0e9-ee5c39c8a3d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:27.154212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a597b18f-34e6-4efb-b0e9-ee5c39c8a3d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047059 Dec 15 16:26:27.154798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 369/724] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:28.166503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-57a5b78d-0bad-4ea0-97c1-8dc39c81bc42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:28.167397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-57a5b78d-0bad-4ea0-97c1-8dc39c81bc42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:28.173974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57a5b78d-0bad-4ea0-97c1-8dc39c81bc42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:28.174417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57a5b78d-0bad-4ea0-97c1-8dc39c81bc42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:28.175182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57a5b78d-0bad-4ea0-97c1-8dc39c81bc42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:28.175611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57a5b78d-0bad-4ea0-97c1-8dc39c81bc42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:28.205400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-57a5b78d-0bad-4ea0-97c1-8dc39c81bc42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042708 Dec 15 16:26:28.205967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 356/725] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:26:29.217378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-42f0bc20-d45d-40ec-8ca5-496b106b9937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:29.218278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-42f0bc20-d45d-40ec-8ca5-496b106b9937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:29.224957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42f0bc20-d45d-40ec-8ca5-496b106b9937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.225370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42f0bc20-d45d-40ec-8ca5-496b106b9937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:29.226170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42f0bc20-d45d-40ec-8ca5-496b106b9937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.226599 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42f0bc20-d45d-40ec-8ca5-496b106b9937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:29.257806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-42f0bc20-d45d-40ec-8ca5-496b106b9937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044263 Dec 15 16:26:29.258411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 370/726] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:30.272098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ca52b967-5b3e-4cb5-97e9-daf34b36a712 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:30.272967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ca52b967-5b3e-4cb5-97e9-daf34b36a712 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:30.279520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ca52b967-5b3e-4cb5-97e9-daf34b36a712 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:30.280059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ca52b967-5b3e-4cb5-97e9-daf34b36a712 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:30.280917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ca52b967-5b3e-4cb5-97e9-daf34b36a712 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:30.281347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ca52b967-5b3e-4cb5-97e9-daf34b36a712 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:30.321756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ca52b967-5b3e-4cb5-97e9-daf34b36a712 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055001 Dec 15 16:26:30.322358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 357/727] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:31.333919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a1b88ea0-4d63-4cdd-80e7-4188c2cbf063 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:31.334838 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a1b88ea0-4d63-4cdd-80e7-4188c2cbf063 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:31.341780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1b88ea0-4d63-4cdd-80e7-4188c2cbf063 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.342237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1b88ea0-4d63-4cdd-80e7-4188c2cbf063 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.343051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1b88ea0-4d63-4cdd-80e7-4188c2cbf063 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.343519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1b88ea0-4d63-4cdd-80e7-4188c2cbf063 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.378666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a1b88ea0-4d63-4cdd-80e7-4188c2cbf063 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048597 Dec 15 16:26:31.379257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 371/728] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:32.390884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-966cb54b-9196-40be-8d90-9e8acca0f1ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:32.391809 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-966cb54b-9196-40be-8d90-9e8acca0f1ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:32.400019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-966cb54b-9196-40be-8d90-9e8acca0f1ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:32.400471 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-966cb54b-9196-40be-8d90-9e8acca0f1ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:32.401382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-966cb54b-9196-40be-8d90-9e8acca0f1ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:32.401819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-966cb54b-9196-40be-8d90-9e8acca0f1ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:32.434340 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-966cb54b-9196-40be-8d90-9e8acca0f1ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047220 Dec 15 16:26:32.434930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 358/729] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:33.447458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fe93f7ca-f5de-4571-a5ef-bacea8fdc84b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:33.448345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fe93f7ca-f5de-4571-a5ef-bacea8fdc84b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:33.454849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe93f7ca-f5de-4571-a5ef-bacea8fdc84b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:33.455289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe93f7ca-f5de-4571-a5ef-bacea8fdc84b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:33.456068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe93f7ca-f5de-4571-a5ef-bacea8fdc84b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:33.456561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe93f7ca-f5de-4571-a5ef-bacea8fdc84b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:33.488638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fe93f7ca-f5de-4571-a5ef-bacea8fdc84b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045004 Dec 15 16:26:33.489210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 372/730] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:34.502660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-afd5f353-2fe1-4b61-8ab7-d7621fbc4c34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:34.503580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-afd5f353-2fe1-4b61-8ab7-d7621fbc4c34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:34.512732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afd5f353-2fe1-4b61-8ab7-d7621fbc4c34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:34.513337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afd5f353-2fe1-4b61-8ab7-d7621fbc4c34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:34.514552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afd5f353-2fe1-4b61-8ab7-d7621fbc4c34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:34.515109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afd5f353-2fe1-4b61-8ab7-d7621fbc4c34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:34.547548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-afd5f353-2fe1-4b61-8ab7-d7621fbc4c34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049437 Dec 15 16:26:34.548140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 359/731] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:35.560379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-91fdfe2e-fa2d-4906-8e4e-3043cef920df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:35.561346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-91fdfe2e-fa2d-4906-8e4e-3043cef920df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:35.569038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91fdfe2e-fa2d-4906-8e4e-3043cef920df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:35.569489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91fdfe2e-fa2d-4906-8e4e-3043cef920df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:35.570304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91fdfe2e-fa2d-4906-8e4e-3043cef920df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:35.570727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91fdfe2e-fa2d-4906-8e4e-3043cef920df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:35.606621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-91fdfe2e-fa2d-4906-8e4e-3043cef920df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050413 Dec 15 16:26:35.607237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 373/732] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:26:36.619472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-618563f5-6bbe-45ef-b512-0be687188422 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:36.620391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-618563f5-6bbe-45ef-b512-0be687188422 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:36.627671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-618563f5-6bbe-45ef-b512-0be687188422 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:36.628206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-618563f5-6bbe-45ef-b512-0be687188422 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:36.629187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-618563f5-6bbe-45ef-b512-0be687188422 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:36.629658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-618563f5-6bbe-45ef-b512-0be687188422 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:36.664824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-618563f5-6bbe-45ef-b512-0be687188422 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049322 Dec 15 16:26:36.665422 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 360/733] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:37.677056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e214685b-6da9-45d9-9a20-e8e5b4501379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:37.678771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e214685b-6da9-45d9-9a20-e8e5b4501379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:37.685959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e214685b-6da9-45d9-9a20-e8e5b4501379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:37.686405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e214685b-6da9-45d9-9a20-e8e5b4501379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:37.687229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e214685b-6da9-45d9-9a20-e8e5b4501379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:37.687696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e214685b-6da9-45d9-9a20-e8e5b4501379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:37.722542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e214685b-6da9-45d9-9a20-e8e5b4501379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049265 Dec 15 16:26:37.723137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 374/734] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:38.738765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-16318119-3f71-4f2f-bfe3-fa4e758483fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:38.741538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-16318119-3f71-4f2f-bfe3-fa4e758483fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:38.752615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16318119-3f71-4f2f-bfe3-fa4e758483fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.753413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16318119-3f71-4f2f-bfe3-fa4e758483fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.754786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16318119-3f71-4f2f-bfe3-fa4e758483fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.755754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16318119-3f71-4f2f-bfe3-fa4e758483fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.804211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-16318119-3f71-4f2f-bfe3-fa4e758483fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072650 Dec 15 16:26:38.804861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 361/735] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:39.816884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d7a37088-d49a-4721-93ea-769e79c76b68 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:39.817797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d7a37088-d49a-4721-93ea-769e79c76b68 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:39.825377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d7a37088-d49a-4721-93ea-769e79c76b68 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:39.825831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d7a37088-d49a-4721-93ea-769e79c76b68 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:39.826647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d7a37088-d49a-4721-93ea-769e79c76b68 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:39.827087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d7a37088-d49a-4721-93ea-769e79c76b68 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:39.871863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d7a37088-d49a-4721-93ea-769e79c76b68 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058507 Dec 15 16:26:39.872956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 375/736] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:40.888155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-06b61479-750d-4ff5-a020-8e2dc47bc448 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:40.889086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-06b61479-750d-4ff5-a020-8e2dc47bc448 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:40.895718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06b61479-750d-4ff5-a020-8e2dc47bc448 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:40.896211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06b61479-750d-4ff5-a020-8e2dc47bc448 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:40.897058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06b61479-750d-4ff5-a020-8e2dc47bc448 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:40.897492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06b61479-750d-4ff5-a020-8e2dc47bc448 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:40.930343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-06b61479-750d-4ff5-a020-8e2dc47bc448 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045962 Dec 15 16:26:40.931001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 362/737] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:41.944423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a3ba16b4-e8b9-448e-8ded-914ed4b37d8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:41.946013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a3ba16b4-e8b9-448e-8ded-914ed4b37d8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:41.954878 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3ba16b4-e8b9-448e-8ded-914ed4b37d8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:41.955829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3ba16b4-e8b9-448e-8ded-914ed4b37d8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:41.956545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3ba16b4-e8b9-448e-8ded-914ed4b37d8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:41.956986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3ba16b4-e8b9-448e-8ded-914ed4b37d8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:41.993870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a3ba16b4-e8b9-448e-8ded-914ed4b37d8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054284 Dec 15 16:26:41.994466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 376/738] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:43.006585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-73b5c7e4-e4f4-4536-ac43-a3f32c0fdb60 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:43.007876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-73b5c7e4-e4f4-4536-ac43-a3f32c0fdb60 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:43.015450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73b5c7e4-e4f4-4536-ac43-a3f32c0fdb60 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:43.016037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73b5c7e4-e4f4-4536-ac43-a3f32c0fdb60 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:43.017312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73b5c7e4-e4f4-4536-ac43-a3f32c0fdb60 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:43.017903 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73b5c7e4-e4f4-4536-ac43-a3f32c0fdb60 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:43.050013 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-73b5c7e4-e4f4-4536-ac43-a3f32c0fdb60 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047387 Dec 15 16:26:43.050601 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 363/739] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:44.064907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f741c5ce-d07e-4f13-9322-0cc6b7777e49 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:44.066016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f741c5ce-d07e-4f13-9322-0cc6b7777e49 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:44.073622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f741c5ce-d07e-4f13-9322-0cc6b7777e49 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:44.074073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f741c5ce-d07e-4f13-9322-0cc6b7777e49 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:44.074874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f741c5ce-d07e-4f13-9322-0cc6b7777e49 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:44.075304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f741c5ce-d07e-4f13-9322-0cc6b7777e49 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:44.108583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f741c5ce-d07e-4f13-9322-0cc6b7777e49 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049117 Dec 15 16:26:44.109179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 377/740] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:45.121836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b4a4a83b-756c-4ec5-9161-9bfe998aa2db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:45.122758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b4a4a83b-756c-4ec5-9161-9bfe998aa2db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:45.129841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b4a4a83b-756c-4ec5-9161-9bfe998aa2db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:45.130297 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b4a4a83b-756c-4ec5-9161-9bfe998aa2db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:45.131108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b4a4a83b-756c-4ec5-9161-9bfe998aa2db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:45.131541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b4a4a83b-756c-4ec5-9161-9bfe998aa2db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:45.167271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b4a4a83b-756c-4ec5-9161-9bfe998aa2db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049481 Dec 15 16:26:45.167918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 364/741] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:46.179860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6346b611-f682-457d-8aa2-5d6194fc8538 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:46.180869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6346b611-f682-457d-8aa2-5d6194fc8538 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:46.187906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6346b611-f682-457d-8aa2-5d6194fc8538 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:46.188352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6346b611-f682-457d-8aa2-5d6194fc8538 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:46.189182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6346b611-f682-457d-8aa2-5d6194fc8538 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:46.189613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6346b611-f682-457d-8aa2-5d6194fc8538 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:46.233420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6346b611-f682-457d-8aa2-5d6194fc8538 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057400 Dec 15 16:26:46.234152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 378/742] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:47.246248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ec311efd-a2ce-4b77-b039-e4c6928853cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:47.247150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ec311efd-a2ce-4b77-b039-e4c6928853cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:47.254127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec311efd-a2ce-4b77-b039-e4c6928853cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:47.254576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec311efd-a2ce-4b77-b039-e4c6928853cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:47.255356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec311efd-a2ce-4b77-b039-e4c6928853cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:47.255793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec311efd-a2ce-4b77-b039-e4c6928853cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:47.286682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ec311efd-a2ce-4b77-b039-e4c6928853cc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044185 Dec 15 16:26:47.287232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 365/743] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:48.299681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7f718c78-14ec-4670-b161-91dc9dd805f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:48.300647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7f718c78-14ec-4670-b161-91dc9dd805f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:48.308187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f718c78-14ec-4670-b161-91dc9dd805f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:48.308683 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f718c78-14ec-4670-b161-91dc9dd805f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:48.309509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f718c78-14ec-4670-b161-91dc9dd805f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:48.309941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f718c78-14ec-4670-b161-91dc9dd805f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:48.343006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7f718c78-14ec-4670-b161-91dc9dd805f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047242 Dec 15 16:26:48.343582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 379/744] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:48 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:49.355266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c3eb9231-223c-4a1f-b753-9cb7af29ff24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:49.356191 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c3eb9231-223c-4a1f-b753-9cb7af29ff24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:49.363662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3eb9231-223c-4a1f-b753-9cb7af29ff24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:49.364105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3eb9231-223c-4a1f-b753-9cb7af29ff24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:49.364929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3eb9231-223c-4a1f-b753-9cb7af29ff24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:49.365717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3eb9231-223c-4a1f-b753-9cb7af29ff24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:49.396527 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c3eb9231-223c-4a1f-b753-9cb7af29ff24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045175 Dec 15 16:26:49.397101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 366/745] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:26:50.408549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9e592869-e317-424a-a4bb-1d84c1232d56 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:50.409497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9e592869-e317-424a-a4bb-1d84c1232d56 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:50.417343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e592869-e317-424a-a4bb-1d84c1232d56 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:50.417789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e592869-e317-424a-a4bb-1d84c1232d56 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:50.418590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e592869-e317-424a-a4bb-1d84c1232d56 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:50.419022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e592869-e317-424a-a4bb-1d84c1232d56 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:50.453020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9e592869-e317-424a-a4bb-1d84c1232d56 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048331 Dec 15 16:26:50.453597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 380/746] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:51.465219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a4985f92-e265-473f-bd7b-794aafed3332 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:51.466000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a4985f92-e265-473f-bd7b-794aafed3332 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:51.472661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4985f92-e265-473f-bd7b-794aafed3332 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.473108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4985f92-e265-473f-bd7b-794aafed3332 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.474074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4985f92-e265-473f-bd7b-794aafed3332 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.474509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a4985f92-e265-473f-bd7b-794aafed3332 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.513178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a4985f92-e265-473f-bd7b-794aafed3332 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051730 Dec 15 16:26:51.513809 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 367/747] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:52.525639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9a0ef570-4c07-48e9-8728-886574b40170 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:52.526443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9a0ef570-4c07-48e9-8728-886574b40170 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:52.533303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a0ef570-4c07-48e9-8728-886574b40170 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.533747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a0ef570-4c07-48e9-8728-886574b40170 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:52.534546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a0ef570-4c07-48e9-8728-886574b40170 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.534970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a0ef570-4c07-48e9-8728-886574b40170 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:52.568853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9a0ef570-4c07-48e9-8728-886574b40170 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047224 Dec 15 16:26:52.569423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 381/748] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:53.581171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cbaf1e5b-a25b-49ea-81db-e172d25fb2c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:53.582095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cbaf1e5b-a25b-49ea-81db-e172d25fb2c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:53.589756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cbaf1e5b-a25b-49ea-81db-e172d25fb2c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.590200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cbaf1e5b-a25b-49ea-81db-e172d25fb2c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.590985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cbaf1e5b-a25b-49ea-81db-e172d25fb2c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.591410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cbaf1e5b-a25b-49ea-81db-e172d25fb2c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.621781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cbaf1e5b-a25b-49ea-81db-e172d25fb2c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044506 Dec 15 16:26:53.623539 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 368/749] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:53.969083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4d6a2a76-0950-422e-97f6-412a2f49996e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:53.969751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4d6a2a76-0950-422e-97f6-412a2f49996e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:53.976207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d6a2a76-0950-422e-97f6-412a2f49996e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.976692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d6a2a76-0950-422e-97f6-412a2f49996e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.977539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d6a2a76-0950-422e-97f6-412a2f49996e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.977961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d6a2a76-0950-422e-97f6-412a2f49996e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.002665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-4d6a2a76-0950-422e-97f6-412a2f49996e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lazy-loading 'flavor' on Instance uuid 4c4fd848-09ba-42aa-9176-dc8a60b95be2 {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:26:54.130734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4d6a2a76-0950-422e-97f6-412a2f49996e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "POST /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2/action" status: 202 len: 0 microversion: 2.1 time: 0.165253 Dec 15 16:26:54.131338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 382/750] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:26:53 2021] POST /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:26:54.147796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6e936a51-11f5-42bf-911d-c652aea73d8f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:54.147796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6e936a51-11f5-42bf-911d-c652aea73d8f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:54.147796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e936a51-11f5-42bf-911d-c652aea73d8f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.147796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e936a51-11f5-42bf-911d-c652aea73d8f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.148468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e936a51-11f5-42bf-911d-c652aea73d8f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.148468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e936a51-11f5-42bf-911d-c652aea73d8f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.298376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6e936a51-11f5-42bf-911d-c652aea73d8f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:54.306450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6e936a51-11f5-42bf-911d-c652aea73d8f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170333 Dec 15 16:26:54.307037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 369/751] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:54 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:54.634883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0af8dd4d-d79e-40eb-bfcf-218577434886 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:54.636047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0af8dd4d-d79e-40eb-bfcf-218577434886 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:54.645379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0af8dd4d-d79e-40eb-bfcf-218577434886 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.645960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0af8dd4d-d79e-40eb-bfcf-218577434886 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.647202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0af8dd4d-d79e-40eb-bfcf-218577434886 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.647775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0af8dd4d-d79e-40eb-bfcf-218577434886 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.682221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0af8dd4d-d79e-40eb-bfcf-218577434886 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052217 Dec 15 16:26:54.682810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 383/752] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:26:55.323549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-71d286f3-d936-464f-8b49-c1f838ee17ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:55.324486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-71d286f3-d936-464f-8b49-c1f838ee17ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:55.331181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71d286f3-d936-464f-8b49-c1f838ee17ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.331639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71d286f3-d936-464f-8b49-c1f838ee17ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.332465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71d286f3-d936-464f-8b49-c1f838ee17ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.332930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71d286f3-d936-464f-8b49-c1f838ee17ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.479869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-71d286f3-d936-464f-8b49-c1f838ee17ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:55.488954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-71d286f3-d936-464f-8b49-c1f838ee17ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169048 Dec 15 16:26:55.489895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 370/753] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:55.701352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-62a9f26a-6bd3-43d1-b748-925133d7e812 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:55.702270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-62a9f26a-6bd3-43d1-b748-925133d7e812 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:55.709536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62a9f26a-6bd3-43d1-b748-925133d7e812 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.709991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62a9f26a-6bd3-43d1-b748-925133d7e812 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.710797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62a9f26a-6bd3-43d1-b748-925133d7e812 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.711237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62a9f26a-6bd3-43d1-b748-925133d7e812 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.742796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-62a9f26a-6bd3-43d1-b748-925133d7e812 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045936 Dec 15 16:26:55.743374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 384/754] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:56.507749 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cf19cca9-2110-4d4d-9104-ef276fbf7906 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:56.508536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cf19cca9-2110-4d4d-9104-ef276fbf7906 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:56.515634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf19cca9-2110-4d4d-9104-ef276fbf7906 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.516111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf19cca9-2110-4d4d-9104-ef276fbf7906 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.516942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf19cca9-2110-4d4d-9104-ef276fbf7906 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.517377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf19cca9-2110-4d4d-9104-ef276fbf7906 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.677817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cf19cca9-2110-4d4d-9104-ef276fbf7906 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:56.686453 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cf19cca9-2110-4d4d-9104-ef276fbf7906 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.182365 Dec 15 16:26:56.687066 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 371/755] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:56.755912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f766f107-f3e7-4ddd-b5b9-8a3b2a478c46 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:56.756867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f766f107-f3e7-4ddd-b5b9-8a3b2a478c46 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:56.763851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f766f107-f3e7-4ddd-b5b9-8a3b2a478c46 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.764307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f766f107-f3e7-4ddd-b5b9-8a3b2a478c46 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.765159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f766f107-f3e7-4ddd-b5b9-8a3b2a478c46 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.765599 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f766f107-f3e7-4ddd-b5b9-8a3b2a478c46 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.800117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f766f107-f3e7-4ddd-b5b9-8a3b2a478c46 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048138 Dec 15 16:26:56.800728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 385/756] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:57.718152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-21ed227f-c726-4b7a-9240-1d0098463f66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:57.719563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-21ed227f-c726-4b7a-9240-1d0098463f66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:57.732468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21ed227f-c726-4b7a-9240-1d0098463f66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.733288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21ed227f-c726-4b7a-9240-1d0098463f66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.734771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21ed227f-c726-4b7a-9240-1d0098463f66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.735274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-21ed227f-c726-4b7a-9240-1d0098463f66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.813357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-750fd8c8-95b5-4eb0-bcac-fe12c54224c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:57.814284 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-750fd8c8-95b5-4eb0-bcac-fe12c54224c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:57.821447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-750fd8c8-95b5-4eb0-bcac-fe12c54224c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.821919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-750fd8c8-95b5-4eb0-bcac-fe12c54224c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.823137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-750fd8c8-95b5-4eb0-bcac-fe12c54224c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.823598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-750fd8c8-95b5-4eb0-bcac-fe12c54224c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.873053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-750fd8c8-95b5-4eb0-bcac-fe12c54224c0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063443 Dec 15 16:26:57.873706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 386/757] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:26:57.906876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-21ed227f-c726-4b7a-9240-1d0098463f66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:57.915540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-21ed227f-c726-4b7a-9240-1d0098463f66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.205312 Dec 15 16:26:57.916703 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 372/758] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:58.889221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e8a722a-f813-4278-87ed-6dc5e6f46f7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:58.890828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1e8a722a-f813-4278-87ed-6dc5e6f46f7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:58.902487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e8a722a-f813-4278-87ed-6dc5e6f46f7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.903274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e8a722a-f813-4278-87ed-6dc5e6f46f7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.904764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e8a722a-f813-4278-87ed-6dc5e6f46f7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.905545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e8a722a-f813-4278-87ed-6dc5e6f46f7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.934346 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b9f417ef-6823-44bf-94fb-7dd5e10eaf7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:58.935202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b9f417ef-6823-44bf-94fb-7dd5e10eaf7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:58.942503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9f417ef-6823-44bf-94fb-7dd5e10eaf7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.943677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9f417ef-6823-44bf-94fb-7dd5e10eaf7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.945197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9f417ef-6823-44bf-94fb-7dd5e10eaf7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.945964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9f417ef-6823-44bf-94fb-7dd5e10eaf7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.960546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1e8a722a-f813-4278-87ed-6dc5e6f46f7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078420 Dec 15 16:26:58.961615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 387/759] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:26:59.115280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b9f417ef-6823-44bf-94fb-7dd5e10eaf7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:59.124390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b9f417ef-6823-44bf-94fb-7dd5e10eaf7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.193914 Dec 15 16:26:59.125031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 373/760] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:59.975419 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-917f5242-6813-4509-b31a-f6a9f2c0dfcf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:59.976318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-917f5242-6813-4509-b31a-f6a9f2c0dfcf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:59.983041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-917f5242-6813-4509-b31a-f6a9f2c0dfcf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:59.983484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-917f5242-6813-4509-b31a-f6a9f2c0dfcf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:59.984264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-917f5242-6813-4509-b31a-f6a9f2c0dfcf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:59.984719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-917f5242-6813-4509-b31a-f6a9f2c0dfcf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:00.014779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-917f5242-6813-4509-b31a-f6a9f2c0dfcf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043243 Dec 15 16:27:00.015369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 388/761] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:26:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:27:00.142431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-221240d5-2c65-4d8e-b92d-71a8592cc81a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:00.143139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-221240d5-2c65-4d8e-b92d-71a8592cc81a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:00.149728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-221240d5-2c65-4d8e-b92d-71a8592cc81a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:00.150222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-221240d5-2c65-4d8e-b92d-71a8592cc81a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:00.151444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-221240d5-2c65-4d8e-b92d-71a8592cc81a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:00.151896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-221240d5-2c65-4d8e-b92d-71a8592cc81a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:00.299367 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-221240d5-2c65-4d8e-b92d-71a8592cc81a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:00.309522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-221240d5-2c65-4d8e-b92d-71a8592cc81a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171244 Dec 15 16:27:00.310672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 374/762] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:01.025827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3c3aca79-ce67-4951-9293-d3ee068dfae8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:01.026770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3c3aca79-ce67-4951-9293-d3ee068dfae8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:01.033690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c3aca79-ce67-4951-9293-d3ee068dfae8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:01.034141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c3aca79-ce67-4951-9293-d3ee068dfae8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:01.034937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c3aca79-ce67-4951-9293-d3ee068dfae8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:01.035370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3c3aca79-ce67-4951-9293-d3ee068dfae8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:01.066103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3c3aca79-ce67-4951-9293-d3ee068dfae8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044098 Dec 15 16:27:01.066665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 389/763] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:01.331372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bc295b9b-cb1a-4d0c-aa83-59a54eca7bc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:01.331998 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bc295b9b-cb1a-4d0c-aa83-59a54eca7bc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:01.340038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc295b9b-cb1a-4d0c-aa83-59a54eca7bc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:01.340472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc295b9b-cb1a-4d0c-aa83-59a54eca7bc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:01.341279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc295b9b-cb1a-4d0c-aa83-59a54eca7bc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:01.341722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc295b9b-cb1a-4d0c-aa83-59a54eca7bc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:01.492328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bc295b9b-cb1a-4d0c-aa83-59a54eca7bc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:01.501348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bc295b9b-cb1a-4d0c-aa83-59a54eca7bc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.175663 Dec 15 16:27:01.502270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 375/764] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:02.083325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a182bdea-9ed2-40be-b6a9-6a9faeb28780 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:02.085130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a182bdea-9ed2-40be-b6a9-6a9faeb28780 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:02.093773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a182bdea-9ed2-40be-b6a9-6a9faeb28780 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:02.094223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a182bdea-9ed2-40be-b6a9-6a9faeb28780 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:02.095057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a182bdea-9ed2-40be-b6a9-6a9faeb28780 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:02.095770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a182bdea-9ed2-40be-b6a9-6a9faeb28780 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:02.136321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a182bdea-9ed2-40be-b6a9-6a9faeb28780 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060370 Dec 15 16:27:02.136982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 390/765] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:02.519286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b94d7ae9-c58b-4160-8d8d-3ab609615764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:02.520009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b94d7ae9-c58b-4160-8d8d-3ab609615764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:02.527326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b94d7ae9-c58b-4160-8d8d-3ab609615764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:02.527774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b94d7ae9-c58b-4160-8d8d-3ab609615764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:02.528640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b94d7ae9-c58b-4160-8d8d-3ab609615764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:02.529072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b94d7ae9-c58b-4160-8d8d-3ab609615764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:02.700393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b94d7ae9-c58b-4160-8d8d-3ab609615764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:02.708541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b94d7ae9-c58b-4160-8d8d-3ab609615764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.193025 Dec 15 16:27:02.709112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 376/766] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:03.149258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8e6656dd-5e98-4776-8087-ceda77ec015b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:03.150224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8e6656dd-5e98-4776-8087-ceda77ec015b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:03.157764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8e6656dd-5e98-4776-8087-ceda77ec015b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.158209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8e6656dd-5e98-4776-8087-ceda77ec015b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.159191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8e6656dd-5e98-4776-8087-ceda77ec015b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.159627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8e6656dd-5e98-4776-8087-ceda77ec015b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.193089 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8e6656dd-5e98-4776-8087-ceda77ec015b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047702 Dec 15 16:27:03.193912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 391/767] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:03.727611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c388aa05-0465-4811-9345-e7e0947c73fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:03.728265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c388aa05-0465-4811-9345-e7e0947c73fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:03.734978 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c388aa05-0465-4811-9345-e7e0947c73fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.735451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c388aa05-0465-4811-9345-e7e0947c73fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.736250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c388aa05-0465-4811-9345-e7e0947c73fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.736732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c388aa05-0465-4811-9345-e7e0947c73fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.883608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c388aa05-0465-4811-9345-e7e0947c73fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:03.891886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c388aa05-0465-4811-9345-e7e0947c73fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168424 Dec 15 16:27:03.892466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 377/768] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:03 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:04.207688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-64cbd766-12a1-486d-a0e7-5a2c9c8670e0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:04.208926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-64cbd766-12a1-486d-a0e7-5a2c9c8670e0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:04.216204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64cbd766-12a1-486d-a0e7-5a2c9c8670e0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.216852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64cbd766-12a1-486d-a0e7-5a2c9c8670e0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:04.217672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64cbd766-12a1-486d-a0e7-5a2c9c8670e0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.218110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64cbd766-12a1-486d-a0e7-5a2c9c8670e0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:04.250822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-64cbd766-12a1-486d-a0e7-5a2c9c8670e0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047886 Dec 15 16:27:04.251490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 392/769] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:04.909289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-338c84cf-404d-4490-8084-bfefc71620b4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:04.909915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-338c84cf-404d-4490-8084-bfefc71620b4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:04.916813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-338c84cf-404d-4490-8084-bfefc71620b4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.917251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-338c84cf-404d-4490-8084-bfefc71620b4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:04.918036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-338c84cf-404d-4490-8084-bfefc71620b4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.918474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-338c84cf-404d-4490-8084-bfefc71620b4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:05.071510 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-338c84cf-404d-4490-8084-bfefc71620b4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:05.080065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-338c84cf-404d-4490-8084-bfefc71620b4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174460 Dec 15 16:27:05.080696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 378/770] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:05.263732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-64a5a8fc-3d52-4622-a64a-1f9be51d0b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:05.264557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-64a5a8fc-3d52-4622-a64a-1f9be51d0b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:05.271473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64a5a8fc-3d52-4622-a64a-1f9be51d0b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:05.271916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64a5a8fc-3d52-4622-a64a-1f9be51d0b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:05.272746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64a5a8fc-3d52-4622-a64a-1f9be51d0b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:05.273183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64a5a8fc-3d52-4622-a64a-1f9be51d0b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:05.304705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-64a5a8fc-3d52-4622-a64a-1f9be51d0b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044850 Dec 15 16:27:05.305256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 393/771] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:06.099157 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8fd336e6-c2d5-45b8-a101-ae58020c7a12 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:06.099777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8fd336e6-c2d5-45b8-a101-ae58020c7a12 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:06.109038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8fd336e6-c2d5-45b8-a101-ae58020c7a12 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:06.109512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8fd336e6-c2d5-45b8-a101-ae58020c7a12 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:06.111550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8fd336e6-c2d5-45b8-a101-ae58020c7a12 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:06.111550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8fd336e6-c2d5-45b8-a101-ae58020c7a12 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:06.263569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8fd336e6-c2d5-45b8-a101-ae58020c7a12 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:06.273125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8fd336e6-c2d5-45b8-a101-ae58020c7a12 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.177240 Dec 15 16:27:06.273343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 379/772] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:06.318780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-73f21fed-93b0-45bd-b218-d04997d56558 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:06.320061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-73f21fed-93b0-45bd-b218-d04997d56558 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:06.331376 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73f21fed-93b0-45bd-b218-d04997d56558 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:06.332180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73f21fed-93b0-45bd-b218-d04997d56558 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:06.333649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73f21fed-93b0-45bd-b218-d04997d56558 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:06.334233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73f21fed-93b0-45bd-b218-d04997d56558 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:06.372692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-73f21fed-93b0-45bd-b218-d04997d56558 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057602 Dec 15 16:27:06.373151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 394/773] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:07.294529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9d65fc5b-f4ec-4361-b854-44aca2bb5ca2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:07.295964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9d65fc5b-f4ec-4361-b854-44aca2bb5ca2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:07.307912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d65fc5b-f4ec-4361-b854-44aca2bb5ca2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:07.308665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d65fc5b-f4ec-4361-b854-44aca2bb5ca2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:07.309677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d65fc5b-f4ec-4361-b854-44aca2bb5ca2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:07.310113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d65fc5b-f4ec-4361-b854-44aca2bb5ca2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:07.386680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cba36efc-4417-45f1-bdd6-777e5dc9d0bc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:07.388014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cba36efc-4417-45f1-bdd6-777e5dc9d0bc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:07.394614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cba36efc-4417-45f1-bdd6-777e5dc9d0bc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:07.395060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cba36efc-4417-45f1-bdd6-777e5dc9d0bc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:07.395893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cba36efc-4417-45f1-bdd6-777e5dc9d0bc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:07.396346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cba36efc-4417-45f1-bdd6-777e5dc9d0bc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:07.430222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cba36efc-4417-45f1-bdd6-777e5dc9d0bc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047513 Dec 15 16:27:07.430849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 395/774] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:07.467983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9d65fc5b-f4ec-4361-b854-44aca2bb5ca2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:07.476157 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9d65fc5b-f4ec-4361-b854-44aca2bb5ca2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.188167 Dec 15 16:27:07.476764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 380/775] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:07 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:08.443453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d12b0f5f-d527-467d-95fe-cd77daa0ec05 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:08.444353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d12b0f5f-d527-467d-95fe-cd77daa0ec05 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:08.451684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d12b0f5f-d527-467d-95fe-cd77daa0ec05 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:08.452125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d12b0f5f-d527-467d-95fe-cd77daa0ec05 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:08.452954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d12b0f5f-d527-467d-95fe-cd77daa0ec05 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:08.453388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d12b0f5f-d527-467d-95fe-cd77daa0ec05 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:08.490125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d12b0f5f-d527-467d-95fe-cd77daa0ec05 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050475 Dec 15 16:27:08.490688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 396/776] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:08.494487 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dcf62bee-662d-4359-8f0e-fbd26d8a7640 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:08.495077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dcf62bee-662d-4359-8f0e-fbd26d8a7640 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:08.502006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dcf62bee-662d-4359-8f0e-fbd26d8a7640 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:08.502455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dcf62bee-662d-4359-8f0e-fbd26d8a7640 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:08.503248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dcf62bee-662d-4359-8f0e-fbd26d8a7640 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:08.503675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dcf62bee-662d-4359-8f0e-fbd26d8a7640 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:08.643120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dcf62bee-662d-4359-8f0e-fbd26d8a7640 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:08.654628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dcf62bee-662d-4359-8f0e-fbd26d8a7640 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.163919 Dec 15 16:27:08.655545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 381/777] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:09.503297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-42f58c9e-5c7e-46fd-a0fc-22fb72ed2144 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:09.504241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-42f58c9e-5c7e-46fd-a0fc-22fb72ed2144 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:09.513908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42f58c9e-5c7e-46fd-a0fc-22fb72ed2144 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:09.514528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42f58c9e-5c7e-46fd-a0fc-22fb72ed2144 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:09.515455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42f58c9e-5c7e-46fd-a0fc-22fb72ed2144 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:09.516007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-42f58c9e-5c7e-46fd-a0fc-22fb72ed2144 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:09.549147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-42f58c9e-5c7e-46fd-a0fc-22fb72ed2144 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050557 Dec 15 16:27:09.549721 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 397/778] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:09.677353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d135597c-56f3-4467-9998-56ec59179233 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:09.678463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d135597c-56f3-4467-9998-56ec59179233 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:09.687065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d135597c-56f3-4467-9998-56ec59179233 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:09.687521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d135597c-56f3-4467-9998-56ec59179233 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:09.688299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d135597c-56f3-4467-9998-56ec59179233 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:09.688761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d135597c-56f3-4467-9998-56ec59179233 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:09.829316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d135597c-56f3-4467-9998-56ec59179233 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:09.841056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d135597c-56f3-4467-9998-56ec59179233 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168048 Dec 15 16:27:09.842409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 382/779] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:10.561873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f224c30a-eb74-46e0-9c08-b89aa9a4358e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:10.562798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f224c30a-eb74-46e0-9c08-b89aa9a4358e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:10.570012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f224c30a-eb74-46e0-9c08-b89aa9a4358e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:10.570462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f224c30a-eb74-46e0-9c08-b89aa9a4358e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:10.571272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f224c30a-eb74-46e0-9c08-b89aa9a4358e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:10.571721 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f224c30a-eb74-46e0-9c08-b89aa9a4358e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:10.605350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f224c30a-eb74-46e0-9c08-b89aa9a4358e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047611 Dec 15 16:27:10.606445 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 398/780] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:27:10.867420 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-749efefd-3668-42fa-bb56-42bed9e91de5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:10.868164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-749efefd-3668-42fa-bb56-42bed9e91de5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:10.878630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-749efefd-3668-42fa-bb56-42bed9e91de5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:10.879269 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-749efefd-3668-42fa-bb56-42bed9e91de5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:10.880373 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-749efefd-3668-42fa-bb56-42bed9e91de5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:10.881079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-749efefd-3668-42fa-bb56-42bed9e91de5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:11.030471 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-749efefd-3668-42fa-bb56-42bed9e91de5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:11.040078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-749efefd-3668-42fa-bb56-42bed9e91de5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.179545 Dec 15 16:27:11.040705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 383/781] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:11.612032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-c22abf4f-6f0e-4546-965b-adc83978ca22 req-c02080e3-0482-4c80-8104-805c9b3700fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4fd848-09ba-42aa-9176-dc8a60b95be2", "name": "network-vif-unplugged", "status": "completed", "tag": "2c61efe0-6ed5-4b49-8a66-8e9f491633d4"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:11.613926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:27:11.613926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:27:11.618606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ad92c61c-3829-4100-a566-42158021f97f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:11.619579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ad92c61c-3829-4100-a566-42158021f97f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:11.622296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-c22abf4f-6f0e-4546-965b-adc83978ca22 req-c02080e3-0482-4c80-8104-805c9b3700fa service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:11.622748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-c22abf4f-6f0e-4546-965b-adc83978ca22 req-c02080e3-0482-4c80-8104-805c9b3700fa service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:11.625973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad92c61c-3829-4100-a566-42158021f97f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:11.626428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad92c61c-3829-4100-a566-42158021f97f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:11.627208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad92c61c-3829-4100-a566-42158021f97f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:11.627654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad92c61c-3829-4100-a566-42158021f97f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:11.635701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-c22abf4f-6f0e-4546-965b-adc83978ca22 req-c02080e3-0482-4c80-8104-805c9b3700fa service nova] Creating event network-vif-unplugged:2c61efe0-6ed5-4b49-8a66-8e9f491633d4 for instance 4c4fd848-09ba-42aa-9176-dc8a60b95be2 on hv-cinder-82002 Dec 15 16:27:11.641228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-c22abf4f-6f0e-4546-965b-adc83978ca22 req-c02080e3-0482-4c80-8104-805c9b3700fa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091535 Dec 15 16:27:11.641873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 399/782] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:27:11 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:27:11.661235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ad92c61c-3829-4100-a566-42158021f97f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046522 Dec 15 16:27:11.662033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 384/783] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:12.060030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d03e3c78-f522-4c1e-9f78-e3c8fd0069e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:12.060747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d03e3c78-f522-4c1e-9f78-e3c8fd0069e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:12.067361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d03e3c78-f522-4c1e-9f78-e3c8fd0069e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:12.067811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d03e3c78-f522-4c1e-9f78-e3c8fd0069e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:12.068621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d03e3c78-f522-4c1e-9f78-e3c8fd0069e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:12.069051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d03e3c78-f522-4c1e-9f78-e3c8fd0069e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:12.228609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d03e3c78-f522-4c1e-9f78-e3c8fd0069e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:12.237512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d03e3c78-f522-4c1e-9f78-e3c8fd0069e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.183181 Dec 15 16:27:12.238125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 400/784] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:12 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:12.676262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5ecc23bb-7cca-4906-9444-ac72b80d702a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:12.677304 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5ecc23bb-7cca-4906-9444-ac72b80d702a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:12.684043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ecc23bb-7cca-4906-9444-ac72b80d702a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:12.684673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ecc23bb-7cca-4906-9444-ac72b80d702a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:12.685477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ecc23bb-7cca-4906-9444-ac72b80d702a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:12.685906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ecc23bb-7cca-4906-9444-ac72b80d702a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:12.719502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5ecc23bb-7cca-4906-9444-ac72b80d702a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048769 Dec 15 16:27:12.720110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 385/785] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:13.257775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4592927e-6891-43a2-aa32-a8f687f34e4b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:13.258400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4592927e-6891-43a2-aa32-a8f687f34e4b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:13.266817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4592927e-6891-43a2-aa32-a8f687f34e4b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:13.267421 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4592927e-6891-43a2-aa32-a8f687f34e4b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:13.268495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4592927e-6891-43a2-aa32-a8f687f34e4b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:13.269119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4592927e-6891-43a2-aa32-a8f687f34e4b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:13.410721 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4592927e-6891-43a2-aa32-a8f687f34e4b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:13.423474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4592927e-6891-43a2-aa32-a8f687f34e4b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170512 Dec 15 16:27:13.424269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 401/786] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:13.733271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-56963eaf-e5d6-4802-a3f7-8773a37ae69b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:13.734071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-56963eaf-e5d6-4802-a3f7-8773a37ae69b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:13.740855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56963eaf-e5d6-4802-a3f7-8773a37ae69b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:13.741668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56963eaf-e5d6-4802-a3f7-8773a37ae69b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:13.742455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56963eaf-e5d6-4802-a3f7-8773a37ae69b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:13.742893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56963eaf-e5d6-4802-a3f7-8773a37ae69b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:13.772466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-56963eaf-e5d6-4802-a3f7-8773a37ae69b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043488 Dec 15 16:27:13.773050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 386/787] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:14.444529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c59b0ea6-6f78-4edd-8815-9e7821fcba56 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:14.445107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c59b0ea6-6f78-4edd-8815-9e7821fcba56 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:14.452036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c59b0ea6-6f78-4edd-8815-9e7821fcba56 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:14.452478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c59b0ea6-6f78-4edd-8815-9e7821fcba56 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:14.453291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c59b0ea6-6f78-4edd-8815-9e7821fcba56 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:14.453719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c59b0ea6-6f78-4edd-8815-9e7821fcba56 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:14.605478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c59b0ea6-6f78-4edd-8815-9e7821fcba56 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:14.614611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c59b0ea6-6f78-4edd-8815-9e7821fcba56 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174031 Dec 15 16:27:14.615195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 402/788] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:27:14.784785 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-33cef170-d65a-4dcd-a3e7-81b64dde2874 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:14.785599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-33cef170-d65a-4dcd-a3e7-81b64dde2874 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:14.792633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33cef170-d65a-4dcd-a3e7-81b64dde2874 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:14.793058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33cef170-d65a-4dcd-a3e7-81b64dde2874 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:14.793875 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33cef170-d65a-4dcd-a3e7-81b64dde2874 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:14.794310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33cef170-d65a-4dcd-a3e7-81b64dde2874 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:14.825813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-33cef170-d65a-4dcd-a3e7-81b64dde2874 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044944 Dec 15 16:27:14.826349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 387/789] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:15.636960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dc8c348d-ee95-4618-8a90-9a53513ecf38 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:15.637572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dc8c348d-ee95-4618-8a90-9a53513ecf38 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:15.644480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dc8c348d-ee95-4618-8a90-9a53513ecf38 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:15.644927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dc8c348d-ee95-4618-8a90-9a53513ecf38 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:15.645712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dc8c348d-ee95-4618-8a90-9a53513ecf38 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:15.646145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dc8c348d-ee95-4618-8a90-9a53513ecf38 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:15.795117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dc8c348d-ee95-4618-8a90-9a53513ecf38 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:15.803350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dc8c348d-ee95-4618-8a90-9a53513ecf38 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171578 Dec 15 16:27:15.803930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 403/790] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:15.840363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4f45084c-d967-42ab-b543-3d28b7fe7855 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:15.841474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4f45084c-d967-42ab-b543-3d28b7fe7855 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:15.851649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f45084c-d967-42ab-b543-3d28b7fe7855 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:15.852229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f45084c-d967-42ab-b543-3d28b7fe7855 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:15.853406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f45084c-d967-42ab-b543-3d28b7fe7855 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:15.853989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f45084c-d967-42ab-b543-3d28b7fe7855 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:15.886894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4f45084c-d967-42ab-b543-3d28b7fe7855 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052397 Dec 15 16:27:15.887466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 388/791] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:16.821958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-baa5ff1f-0861-41b5-877e-3b28da15091f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:16.822563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-baa5ff1f-0861-41b5-877e-3b28da15091f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:16.829707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-baa5ff1f-0861-41b5-877e-3b28da15091f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:16.830138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-baa5ff1f-0861-41b5-877e-3b28da15091f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:16.830926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-baa5ff1f-0861-41b5-877e-3b28da15091f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:16.831358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-baa5ff1f-0861-41b5-877e-3b28da15091f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:16.899991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e44aeddd-dd51-4a84-9cd5-ad8022c02391 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:16.901042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e44aeddd-dd51-4a84-9cd5-ad8022c02391 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:16.907906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e44aeddd-dd51-4a84-9cd5-ad8022c02391 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:16.908406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e44aeddd-dd51-4a84-9cd5-ad8022c02391 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:16.909225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e44aeddd-dd51-4a84-9cd5-ad8022c02391 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:16.909649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e44aeddd-dd51-4a84-9cd5-ad8022c02391 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:16.940418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e44aeddd-dd51-4a84-9cd5-ad8022c02391 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044018 Dec 15 16:27:16.941026 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 389/792] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:16 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:16.972344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-baa5ff1f-0861-41b5-877e-3b28da15091f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:16.984412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-baa5ff1f-0861-41b5-877e-3b28da15091f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165969 Dec 15 16:27:16.985288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 404/793] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:16 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:17.954337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6441a0bb-b3ff-4919-b6f7-3dfc380246ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:17.955697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6441a0bb-b3ff-4919-b6f7-3dfc380246ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:17.964640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6441a0bb-b3ff-4919-b6f7-3dfc380246ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:17.965294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6441a0bb-b3ff-4919-b6f7-3dfc380246ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:17.966225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6441a0bb-b3ff-4919-b6f7-3dfc380246ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:17.966787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6441a0bb-b3ff-4919-b6f7-3dfc380246ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:18.001148 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6441a0bb-b3ff-4919-b6f7-3dfc380246ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051891 Dec 15 16:27:18.001725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 390/794] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:18.006647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8a203d3d-0907-46bf-a6b3-f6fcfd820591 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:18.007416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8a203d3d-0907-46bf-a6b3-f6fcfd820591 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:18.014147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a203d3d-0907-46bf-a6b3-f6fcfd820591 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:18.014640 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a203d3d-0907-46bf-a6b3-f6fcfd820591 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:18.015482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a203d3d-0907-46bf-a6b3-f6fcfd820591 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:18.015897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a203d3d-0907-46bf-a6b3-f6fcfd820591 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:18.168042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8a203d3d-0907-46bf-a6b3-f6fcfd820591 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:18.175810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8a203d3d-0907-46bf-a6b3-f6fcfd820591 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173168 Dec 15 16:27:18.176378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 405/795] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:19.015247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4d9f7540-3ae2-468d-889d-780bd33972a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:19.016644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4d9f7540-3ae2-468d-889d-780bd33972a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:19.023513 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d9f7540-3ae2-468d-889d-780bd33972a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:19.023989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d9f7540-3ae2-468d-889d-780bd33972a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:19.024818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d9f7540-3ae2-468d-889d-780bd33972a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:19.025229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d9f7540-3ae2-468d-889d-780bd33972a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:19.056921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4d9f7540-3ae2-468d-889d-780bd33972a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046849 Dec 15 16:27:19.057484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 391/796] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:19.196007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b60ca7b2-2fd3-4564-918d-083446c62ae8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:19.196756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b60ca7b2-2fd3-4564-918d-083446c62ae8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:19.203501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b60ca7b2-2fd3-4564-918d-083446c62ae8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:19.203941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b60ca7b2-2fd3-4564-918d-083446c62ae8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:19.204790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b60ca7b2-2fd3-4564-918d-083446c62ae8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:19.205428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b60ca7b2-2fd3-4564-918d-083446c62ae8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:19.358231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b60ca7b2-2fd3-4564-918d-083446c62ae8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:19.369425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b60ca7b2-2fd3-4564-918d-083446c62ae8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.179198 Dec 15 16:27:19.370271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 406/797] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:20.070069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1643fd35-d714-4766-8129-d305c15a17fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:20.070957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1643fd35-d714-4766-8129-d305c15a17fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:20.077908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1643fd35-d714-4766-8129-d305c15a17fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:20.078354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1643fd35-d714-4766-8129-d305c15a17fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:20.079152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1643fd35-d714-4766-8129-d305c15a17fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:20.079589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1643fd35-d714-4766-8129-d305c15a17fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:20.112565 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1643fd35-d714-4766-8129-d305c15a17fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045537 Dec 15 16:27:20.112846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 392/798] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:20.389616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-548b98c3-2b9c-47eb-90b6-9457f53db1c9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:20.390196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-548b98c3-2b9c-47eb-90b6-9457f53db1c9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:20.397778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-548b98c3-2b9c-47eb-90b6-9457f53db1c9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:20.398260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-548b98c3-2b9c-47eb-90b6-9457f53db1c9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:20.399065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-548b98c3-2b9c-47eb-90b6-9457f53db1c9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:20.399506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-548b98c3-2b9c-47eb-90b6-9457f53db1c9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:20.550030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-548b98c3-2b9c-47eb-90b6-9457f53db1c9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:20.558188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-548b98c3-2b9c-47eb-90b6-9457f53db1c9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172721 Dec 15 16:27:20.558776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 407/799] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:20 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:21.124055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1c01d6c5-9a1e-4d58-9bc5-9e65fdb67322 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:21.124847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1c01d6c5-9a1e-4d58-9bc5-9e65fdb67322 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:21.132155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c01d6c5-9a1e-4d58-9bc5-9e65fdb67322 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:21.132617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c01d6c5-9a1e-4d58-9bc5-9e65fdb67322 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:21.133415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c01d6c5-9a1e-4d58-9bc5-9e65fdb67322 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:21.133840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c01d6c5-9a1e-4d58-9bc5-9e65fdb67322 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:21.167314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1c01d6c5-9a1e-4d58-9bc5-9e65fdb67322 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047202 Dec 15 16:27:21.167891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 393/800] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:21.576864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1dce6877-2706-4291-a915-5cc3ba95e747 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:21.577494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1dce6877-2706-4291-a915-5cc3ba95e747 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:21.584123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1dce6877-2706-4291-a915-5cc3ba95e747 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:21.584679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1dce6877-2706-4291-a915-5cc3ba95e747 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:21.585491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1dce6877-2706-4291-a915-5cc3ba95e747 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:21.585929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1dce6877-2706-4291-a915-5cc3ba95e747 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:21.721838 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1dce6877-2706-4291-a915-5cc3ba95e747 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:21.730336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1dce6877-2706-4291-a915-5cc3ba95e747 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.157890 Dec 15 16:27:21.730918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 408/801] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:22.179215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a9bf3840-a501-4900-b9be-f9e27fae1e02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:22.180850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a9bf3840-a501-4900-b9be-f9e27fae1e02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:22.187479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9bf3840-a501-4900-b9be-f9e27fae1e02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:22.187924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9bf3840-a501-4900-b9be-f9e27fae1e02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:22.188752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9bf3840-a501-4900-b9be-f9e27fae1e02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:22.189186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9bf3840-a501-4900-b9be-f9e27fae1e02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:22.219483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a9bf3840-a501-4900-b9be-f9e27fae1e02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044225 Dec 15 16:27:22.220039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 394/802] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:22.751660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ca09d7fb-d0d2-4c85-b391-ac377d9d65f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:22.752322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ca09d7fb-d0d2-4c85-b391-ac377d9d65f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:22.762410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca09d7fb-d0d2-4c85-b391-ac377d9d65f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:22.763033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca09d7fb-d0d2-4c85-b391-ac377d9d65f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:22.764219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca09d7fb-d0d2-4c85-b391-ac377d9d65f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:22.764904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca09d7fb-d0d2-4c85-b391-ac377d9d65f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:22.915539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ca09d7fb-d0d2-4c85-b391-ac377d9d65f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:22.927622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ca09d7fb-d0d2-4c85-b391-ac377d9d65f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.181354 Dec 15 16:27:22.928569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 409/803] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:22 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:23.231578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-33fb4de7-bb01-4c44-b063-fa431f1c12fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:23.232458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-33fb4de7-bb01-4c44-b063-fa431f1c12fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:23.239237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33fb4de7-bb01-4c44-b063-fa431f1c12fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:23.239688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33fb4de7-bb01-4c44-b063-fa431f1c12fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:23.240475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33fb4de7-bb01-4c44-b063-fa431f1c12fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:23.240921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33fb4de7-bb01-4c44-b063-fa431f1c12fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:23.271083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-33fb4de7-bb01-4c44-b063-fa431f1c12fa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043410 Dec 15 16:27:23.271665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 395/804] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:23.949385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0e0c2bd6-2918-4fd5-86ca-6f4a4d5d2e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:23.950027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0e0c2bd6-2918-4fd5-86ca-6f4a4d5d2e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:23.958025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e0c2bd6-2918-4fd5-86ca-6f4a4d5d2e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:23.958475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e0c2bd6-2918-4fd5-86ca-6f4a4d5d2e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:23.959473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e0c2bd6-2918-4fd5-86ca-6f4a4d5d2e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:23.960004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e0c2bd6-2918-4fd5-86ca-6f4a4d5d2e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:24.111138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e0c2bd6-2918-4fd5-86ca-6f4a4d5d2e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:24.120407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0e0c2bd6-2918-4fd5-86ca-6f4a4d5d2e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174614 Dec 15 16:27:24.121036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 410/805] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:23 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:24.283786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-63f07755-48a7-4a83-90eb-4e6f5a669742 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:24.284643 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-63f07755-48a7-4a83-90eb-4e6f5a669742 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:24.292410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63f07755-48a7-4a83-90eb-4e6f5a669742 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:24.292887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63f07755-48a7-4a83-90eb-4e6f5a669742 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:24.293682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63f07755-48a7-4a83-90eb-4e6f5a669742 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:24.294104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63f07755-48a7-4a83-90eb-4e6f5a669742 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:24.327158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-63f07755-48a7-4a83-90eb-4e6f5a669742 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047233 Dec 15 16:27:24.327794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 396/806] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:25.138083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-70f87aa0-f540-4df2-8b95-de76c93ffaad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:25.138673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-70f87aa0-f540-4df2-8b95-de76c93ffaad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:25.145546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-70f87aa0-f540-4df2-8b95-de76c93ffaad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:25.145997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-70f87aa0-f540-4df2-8b95-de76c93ffaad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:25.146778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-70f87aa0-f540-4df2-8b95-de76c93ffaad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:25.147206 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-70f87aa0-f540-4df2-8b95-de76c93ffaad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:25.288219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-70f87aa0-f540-4df2-8b95-de76c93ffaad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:25.300373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-70f87aa0-f540-4df2-8b95-de76c93ffaad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165651 Dec 15 16:27:25.301170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 411/807] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:25.341748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f571849f-2fb2-4065-8e47-1b63275427aa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:25.342795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f571849f-2fb2-4065-8e47-1b63275427aa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:25.351235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f571849f-2fb2-4065-8e47-1b63275427aa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:25.351688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f571849f-2fb2-4065-8e47-1b63275427aa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:25.352478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f571849f-2fb2-4065-8e47-1b63275427aa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:25.352952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f571849f-2fb2-4065-8e47-1b63275427aa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:25.383462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f571849f-2fb2-4065-8e47-1b63275427aa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047462 Dec 15 16:27:25.384176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 397/808] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:26.326058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dee352ea-2b7f-464a-82db-fe363414fc29 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:26.326745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dee352ea-2b7f-464a-82db-fe363414fc29 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:26.334524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dee352ea-2b7f-464a-82db-fe363414fc29 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:26.334948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dee352ea-2b7f-464a-82db-fe363414fc29 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:26.335766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dee352ea-2b7f-464a-82db-fe363414fc29 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:26.336188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dee352ea-2b7f-464a-82db-fe363414fc29 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:26.395366 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dca704eb-6229-496d-b0d7-4c66707d9640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:26.396192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dca704eb-6229-496d-b0d7-4c66707d9640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:26.402832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dca704eb-6229-496d-b0d7-4c66707d9640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:26.403292 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dca704eb-6229-496d-b0d7-4c66707d9640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:26.404311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dca704eb-6229-496d-b0d7-4c66707d9640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:26.404788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dca704eb-6229-496d-b0d7-4c66707d9640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:26.436374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dca704eb-6229-496d-b0d7-4c66707d9640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043854 Dec 15 16:27:26.437064 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 398/809] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:26.473846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dee352ea-2b7f-464a-82db-fe363414fc29 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:26.481558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dee352ea-2b7f-464a-82db-fe363414fc29 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.160962 Dec 15 16:27:26.482326 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 412/810] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:26 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:27.449686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-907d702c-e38b-4745-88d3-33c59b8f3352 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:27.450499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-907d702c-e38b-4745-88d3-33c59b8f3352 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:27.458024 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-907d702c-e38b-4745-88d3-33c59b8f3352 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:27.458750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-907d702c-e38b-4745-88d3-33c59b8f3352 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:27.459964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-907d702c-e38b-4745-88d3-33c59b8f3352 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:27.460639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-907d702c-e38b-4745-88d3-33c59b8f3352 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:27.501883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-43d2733e-c848-4fa1-9a25-ff2fe83c83a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:27.502839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-43d2733e-c848-4fa1-9a25-ff2fe83c83a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:27.502963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-907d702c-e38b-4745-88d3-33c59b8f3352 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057140 Dec 15 16:27:27.503565 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 399/811] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:27.509496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43d2733e-c848-4fa1-9a25-ff2fe83c83a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:27.509936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43d2733e-c848-4fa1-9a25-ff2fe83c83a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:27.510718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43d2733e-c848-4fa1-9a25-ff2fe83c83a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:27.511146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43d2733e-c848-4fa1-9a25-ff2fe83c83a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:27.655697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-43d2733e-c848-4fa1-9a25-ff2fe83c83a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:27.666526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-43d2733e-c848-4fa1-9a25-ff2fe83c83a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170208 Dec 15 16:27:27.667218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 413/812] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:28.515232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5c8e70b4-e0f0-4cd5-8716-1ec6bd60b717 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:28.516139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5c8e70b4-e0f0-4cd5-8716-1ec6bd60b717 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:28.523146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c8e70b4-e0f0-4cd5-8716-1ec6bd60b717 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:28.523597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c8e70b4-e0f0-4cd5-8716-1ec6bd60b717 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:28.524400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c8e70b4-e0f0-4cd5-8716-1ec6bd60b717 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:28.524863 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c8e70b4-e0f0-4cd5-8716-1ec6bd60b717 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:28.555276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5c8e70b4-e0f0-4cd5-8716-1ec6bd60b717 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043858 Dec 15 16:27:28.555848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 400/813] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:28.690311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ce7029a1-5591-467d-a95b-a632c0bce677 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:28.690935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ce7029a1-5591-467d-a95b-a632c0bce677 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:28.697715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce7029a1-5591-467d-a95b-a632c0bce677 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:28.698159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce7029a1-5591-467d-a95b-a632c0bce677 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:28.698937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce7029a1-5591-467d-a95b-a632c0bce677 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:28.699360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce7029a1-5591-467d-a95b-a632c0bce677 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:28.844189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ce7029a1-5591-467d-a95b-a632c0bce677 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:28.852594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ce7029a1-5591-467d-a95b-a632c0bce677 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166076 Dec 15 16:27:28.853175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 414/814] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:29.569166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7f366037-e101-4053-843c-6f33ea2f0e6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:29.570070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7f366037-e101-4053-843c-6f33ea2f0e6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:29.576920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f366037-e101-4053-843c-6f33ea2f0e6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:29.577372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f366037-e101-4053-843c-6f33ea2f0e6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:29.578128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f366037-e101-4053-843c-6f33ea2f0e6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:29.578591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f366037-e101-4053-843c-6f33ea2f0e6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:29.609522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7f366037-e101-4053-843c-6f33ea2f0e6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044966 Dec 15 16:27:29.610128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 401/815] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:29.872201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-26cdb9d4-371e-46ef-80c9-0dce807ece88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:29.872853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-26cdb9d4-371e-46ef-80c9-0dce807ece88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:29.879686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26cdb9d4-371e-46ef-80c9-0dce807ece88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:29.880462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26cdb9d4-371e-46ef-80c9-0dce807ece88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:29.881294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26cdb9d4-371e-46ef-80c9-0dce807ece88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:29.881888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26cdb9d4-371e-46ef-80c9-0dce807ece88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:30.028044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-26cdb9d4-371e-46ef-80c9-0dce807ece88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:30.039845 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-26cdb9d4-371e-46ef-80c9-0dce807ece88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171550 Dec 15 16:27:30.040398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 415/816] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:30.623273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-60aaf5a0-499c-4647-b114-782dd1bd7367 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:30.624397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-60aaf5a0-499c-4647-b114-782dd1bd7367 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:30.633431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60aaf5a0-499c-4647-b114-782dd1bd7367 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:30.633790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60aaf5a0-499c-4647-b114-782dd1bd7367 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:30.634546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60aaf5a0-499c-4647-b114-782dd1bd7367 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:30.634969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60aaf5a0-499c-4647-b114-782dd1bd7367 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:30.665288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-60aaf5a0-499c-4647-b114-782dd1bd7367 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046588 Dec 15 16:27:30.665974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 402/817] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:31.061288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e2eb0ab7-c5ae-4608-8a64-607b00e22ced tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:31.061984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e2eb0ab7-c5ae-4608-8a64-607b00e22ced tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:31.068869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2eb0ab7-c5ae-4608-8a64-607b00e22ced tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:31.069307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2eb0ab7-c5ae-4608-8a64-607b00e22ced tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:31.070123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2eb0ab7-c5ae-4608-8a64-607b00e22ced tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:31.070551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2eb0ab7-c5ae-4608-8a64-607b00e22ced tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:31.232705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e2eb0ab7-c5ae-4608-8a64-607b00e22ced tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:31.241485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e2eb0ab7-c5ae-4608-8a64-607b00e22ced tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.183853 Dec 15 16:27:31.242325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 416/818] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:31 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:31.679140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-38f9cce7-78c3-4c6a-8111-e3b464e42ce9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:31.680338 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-38f9cce7-78c3-4c6a-8111-e3b464e42ce9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:31.688553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-38f9cce7-78c3-4c6a-8111-e3b464e42ce9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:31.688998 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-38f9cce7-78c3-4c6a-8111-e3b464e42ce9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:31.690156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-38f9cce7-78c3-4c6a-8111-e3b464e42ce9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:31.690930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-38f9cce7-78c3-4c6a-8111-e3b464e42ce9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:31.724997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-38f9cce7-78c3-4c6a-8111-e3b464e42ce9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051373 Dec 15 16:27:31.726081 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 403/819] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:32.262340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2e83d08d-ae5b-4ee7-90d8-e94d973258ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:32.262930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2e83d08d-ae5b-4ee7-90d8-e94d973258ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:32.269622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e83d08d-ae5b-4ee7-90d8-e94d973258ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:32.270064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e83d08d-ae5b-4ee7-90d8-e94d973258ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:32.270890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e83d08d-ae5b-4ee7-90d8-e94d973258ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:32.271386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e83d08d-ae5b-4ee7-90d8-e94d973258ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:32.417661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2e83d08d-ae5b-4ee7-90d8-e94d973258ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:32.425805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2e83d08d-ae5b-4ee7-90d8-e94d973258ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.167141 Dec 15 16:27:32.426480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 417/820] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:32.737971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eafe8ded-4e10-4142-959a-628e3d82b8c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:32.738782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eafe8ded-4e10-4142-959a-628e3d82b8c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:32.745746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eafe8ded-4e10-4142-959a-628e3d82b8c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:32.746190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eafe8ded-4e10-4142-959a-628e3d82b8c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:32.746964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eafe8ded-4e10-4142-959a-628e3d82b8c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:32.747397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eafe8ded-4e10-4142-959a-628e3d82b8c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:32.778552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eafe8ded-4e10-4142-959a-628e3d82b8c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044745 Dec 15 16:27:32.779108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 404/821] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:33.444155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b27b2173-6b82-4518-9a31-0904f11d3299 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:33.444738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b27b2173-6b82-4518-9a31-0904f11d3299 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:33.451208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b27b2173-6b82-4518-9a31-0904f11d3299 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:33.451685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b27b2173-6b82-4518-9a31-0904f11d3299 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:33.452472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b27b2173-6b82-4518-9a31-0904f11d3299 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:33.452918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b27b2173-6b82-4518-9a31-0904f11d3299 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:33.588423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b27b2173-6b82-4518-9a31-0904f11d3299 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:33.597180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b27b2173-6b82-4518-9a31-0904f11d3299 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.156826 Dec 15 16:27:33.598279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 418/822] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:33.791788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1a633253-b948-466e-bc88-102ffd779498 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:33.792671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1a633253-b948-466e-bc88-102ffd779498 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:33.801091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a633253-b948-466e-bc88-102ffd779498 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:33.801524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a633253-b948-466e-bc88-102ffd779498 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:33.802319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a633253-b948-466e-bc88-102ffd779498 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:33.802743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a633253-b948-466e-bc88-102ffd779498 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:33.832554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1a633253-b948-466e-bc88-102ffd779498 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045630 Dec 15 16:27:33.833129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 405/823] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:27:34.618426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e5e9106-4dd2-445b-9430-4ef0c9e4f755 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:34.619042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1e5e9106-4dd2-445b-9430-4ef0c9e4f755 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:34.625988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e5e9106-4dd2-445b-9430-4ef0c9e4f755 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:34.626452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e5e9106-4dd2-445b-9430-4ef0c9e4f755 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:34.627250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e5e9106-4dd2-445b-9430-4ef0c9e4f755 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:34.627980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e5e9106-4dd2-445b-9430-4ef0c9e4f755 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:34.771133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1e5e9106-4dd2-445b-9430-4ef0c9e4f755 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:34.782737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1e5e9106-4dd2-445b-9430-4ef0c9e4f755 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168156 Dec 15 16:27:34.783676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 419/824] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:34 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:34.848240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6cc6b374-1b61-4e15-bf88-f47ab20c4354 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:34.849157 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6cc6b374-1b61-4e15-bf88-f47ab20c4354 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:34.855771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6cc6b374-1b61-4e15-bf88-f47ab20c4354 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:34.856211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6cc6b374-1b61-4e15-bf88-f47ab20c4354 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:34.857027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6cc6b374-1b61-4e15-bf88-f47ab20c4354 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:34.857456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6cc6b374-1b61-4e15-bf88-f47ab20c4354 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:34.890218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6cc6b374-1b61-4e15-bf88-f47ab20c4354 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046775 Dec 15 16:27:34.890684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 406/825] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:35.805926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9207330c-b327-4f9d-be4c-531cb2c8c1d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:35.806587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9207330c-b327-4f9d-be4c-531cb2c8c1d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:35.814311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9207330c-b327-4f9d-be4c-531cb2c8c1d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:35.814943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9207330c-b327-4f9d-be4c-531cb2c8c1d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:35.816138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9207330c-b327-4f9d-be4c-531cb2c8c1d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:35.816600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9207330c-b327-4f9d-be4c-531cb2c8c1d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:35.903062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7a622eb4-df97-45e6-87c6-37925e4e44a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:35.903960 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7a622eb4-df97-45e6-87c6-37925e4e44a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:35.910983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a622eb4-df97-45e6-87c6-37925e4e44a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:35.911429 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a622eb4-df97-45e6-87c6-37925e4e44a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:35.912231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a622eb4-df97-45e6-87c6-37925e4e44a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:35.912697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7a622eb4-df97-45e6-87c6-37925e4e44a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:35.945480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7a622eb4-df97-45e6-87c6-37925e4e44a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046810 Dec 15 16:27:35.946075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 407/826] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:27:35.965951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9207330c-b327-4f9d-be4c-531cb2c8c1d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:35.973900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9207330c-b327-4f9d-be4c-531cb2c8c1d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172470 Dec 15 16:27:35.974473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 420/827] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:36.959331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0ad26014-61a1-46e5-94dd-883bf5dc4c06 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:36.960266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0ad26014-61a1-46e5-94dd-883bf5dc4c06 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:36.967032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ad26014-61a1-46e5-94dd-883bf5dc4c06 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:36.967476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ad26014-61a1-46e5-94dd-883bf5dc4c06 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:36.968248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ad26014-61a1-46e5-94dd-883bf5dc4c06 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:36.968717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ad26014-61a1-46e5-94dd-883bf5dc4c06 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:36.994381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a1a858c3-435f-4393-bc57-c89a39ba4f50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:36.994996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a1a858c3-435f-4393-bc57-c89a39ba4f50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:37.001952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1a858c3-435f-4393-bc57-c89a39ba4f50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:37.002402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1a858c3-435f-4393-bc57-c89a39ba4f50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:37.003039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0ad26014-61a1-46e5-94dd-883bf5dc4c06 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048115 Dec 15 16:27:37.003187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1a858c3-435f-4393-bc57-c89a39ba4f50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:37.004537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1a858c3-435f-4393-bc57-c89a39ba4f50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:37.006892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 408/828] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:37.143723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a1a858c3-435f-4393-bc57-c89a39ba4f50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:37.152086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a1a858c3-435f-4393-bc57-c89a39ba4f50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.164445 Dec 15 16:27:37.152698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 421/829] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:36 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:38.017618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-41d99372-1f46-4860-aaca-6398cd5b0fb1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:38.019082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-41d99372-1f46-4860-aaca-6398cd5b0fb1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:38.028478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41d99372-1f46-4860-aaca-6398cd5b0fb1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.028943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41d99372-1f46-4860-aaca-6398cd5b0fb1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.029999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41d99372-1f46-4860-aaca-6398cd5b0fb1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.030630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41d99372-1f46-4860-aaca-6398cd5b0fb1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.062151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-41d99372-1f46-4860-aaca-6398cd5b0fb1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050508 Dec 15 16:27:38.062695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 409/830] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:38.171214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dd5f1ebb-cf3d-4cdc-b11a-ba12bd8c3b47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:38.171919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dd5f1ebb-cf3d-4cdc-b11a-ba12bd8c3b47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:38.178430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd5f1ebb-cf3d-4cdc-b11a-ba12bd8c3b47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.178877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd5f1ebb-cf3d-4cdc-b11a-ba12bd8c3b47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.179710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd5f1ebb-cf3d-4cdc-b11a-ba12bd8c3b47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.180129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd5f1ebb-cf3d-4cdc-b11a-ba12bd8c3b47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.318527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dd5f1ebb-cf3d-4cdc-b11a-ba12bd8c3b47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:38.325985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dd5f1ebb-cf3d-4cdc-b11a-ba12bd8c3b47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.158996 Dec 15 16:27:38.326563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 422/831] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:39.075801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1759b1ad-aaeb-4381-997a-edec90bc548f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:39.076741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1759b1ad-aaeb-4381-997a-edec90bc548f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:39.083673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1759b1ad-aaeb-4381-997a-edec90bc548f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:39.084119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1759b1ad-aaeb-4381-997a-edec90bc548f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:39.084959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1759b1ad-aaeb-4381-997a-edec90bc548f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:39.085393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1759b1ad-aaeb-4381-997a-edec90bc548f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:39.116516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1759b1ad-aaeb-4381-997a-edec90bc548f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044642 Dec 15 16:27:39.117119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 410/832] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:39.345867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f67f3837-57a6-4388-bbbb-6ac254a5d01f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:39.346726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f67f3837-57a6-4388-bbbb-6ac254a5d01f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:39.353601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f67f3837-57a6-4388-bbbb-6ac254a5d01f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:39.354077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f67f3837-57a6-4388-bbbb-6ac254a5d01f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:39.354861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f67f3837-57a6-4388-bbbb-6ac254a5d01f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:39.355288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f67f3837-57a6-4388-bbbb-6ac254a5d01f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:39.490691 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f67f3837-57a6-4388-bbbb-6ac254a5d01f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:39.498686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f67f3837-57a6-4388-bbbb-6ac254a5d01f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.157506 Dec 15 16:27:39.499261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 423/833] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:40.129534 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7924649a-1628-441d-9e15-65b3af0a28f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:40.130907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7924649a-1628-441d-9e15-65b3af0a28f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:40.141376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7924649a-1628-441d-9e15-65b3af0a28f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:40.142108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7924649a-1628-441d-9e15-65b3af0a28f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:40.143326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7924649a-1628-441d-9e15-65b3af0a28f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:40.143761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7924649a-1628-441d-9e15-65b3af0a28f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:40.174685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7924649a-1628-441d-9e15-65b3af0a28f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050618 Dec 15 16:27:40.175251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 411/834] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:40.516854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b6e871fe-83c7-4458-a8b9-72ce97bc4278 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:40.517434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b6e871fe-83c7-4458-a8b9-72ce97bc4278 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:40.525710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6e871fe-83c7-4458-a8b9-72ce97bc4278 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:40.526304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6e871fe-83c7-4458-a8b9-72ce97bc4278 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:40.527375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6e871fe-83c7-4458-a8b9-72ce97bc4278 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:40.527944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6e871fe-83c7-4458-a8b9-72ce97bc4278 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:40.670294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b6e871fe-83c7-4458-a8b9-72ce97bc4278 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:40.682057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b6e871fe-83c7-4458-a8b9-72ce97bc4278 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168722 Dec 15 16:27:40.682958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 424/835] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:40 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:41.189940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b674bd1f-06ec-492b-9db6-c17be6ac4721 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:41.190912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b674bd1f-06ec-492b-9db6-c17be6ac4721 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:41.199011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b674bd1f-06ec-492b-9db6-c17be6ac4721 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:41.199457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b674bd1f-06ec-492b-9db6-c17be6ac4721 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:41.200247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b674bd1f-06ec-492b-9db6-c17be6ac4721 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:41.200717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b674bd1f-06ec-492b-9db6-c17be6ac4721 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:41.231477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b674bd1f-06ec-492b-9db6-c17be6ac4721 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047224 Dec 15 16:27:41.232078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 412/836] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:41.706328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-88d169a7-42a8-4664-aeea-4bc3e217a2d8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:41.707181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-88d169a7-42a8-4664-aeea-4bc3e217a2d8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:41.715672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88d169a7-42a8-4664-aeea-4bc3e217a2d8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:41.716077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88d169a7-42a8-4664-aeea-4bc3e217a2d8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:41.716897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88d169a7-42a8-4664-aeea-4bc3e217a2d8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:41.717280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-88d169a7-42a8-4664-aeea-4bc3e217a2d8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:41.874855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-88d169a7-42a8-4664-aeea-4bc3e217a2d8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:41.883417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-88d169a7-42a8-4664-aeea-4bc3e217a2d8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.183245 Dec 15 16:27:41.884261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 425/837] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:41 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:42.243937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-42cefc5d-5fc0-43b6-bf56-eb9fc1a7c77e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:42.244897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-42cefc5d-5fc0-43b6-bf56-eb9fc1a7c77e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:42.251992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42cefc5d-5fc0-43b6-bf56-eb9fc1a7c77e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:42.252460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42cefc5d-5fc0-43b6-bf56-eb9fc1a7c77e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:42.253260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42cefc5d-5fc0-43b6-bf56-eb9fc1a7c77e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:42.253694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42cefc5d-5fc0-43b6-bf56-eb9fc1a7c77e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:42.284346 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-42cefc5d-5fc0-43b6-bf56-eb9fc1a7c77e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044666 Dec 15 16:27:42.284945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 413/838] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:42.901407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0c0dcc68-fb21-4f5c-a13f-71a15ceaaa59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:42.902036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0c0dcc68-fb21-4f5c-a13f-71a15ceaaa59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:42.908989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c0dcc68-fb21-4f5c-a13f-71a15ceaaa59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:42.909440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c0dcc68-fb21-4f5c-a13f-71a15ceaaa59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:42.910260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c0dcc68-fb21-4f5c-a13f-71a15ceaaa59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:42.910743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c0dcc68-fb21-4f5c-a13f-71a15ceaaa59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:43.062999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0c0dcc68-fb21-4f5c-a13f-71a15ceaaa59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:43.073788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0c0dcc68-fb21-4f5c-a13f-71a15ceaaa59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176353 Dec 15 16:27:43.074509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 426/839] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:42 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:43.298190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eb841ba3-a038-45c6-bf82-9cf767d61cb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:43.299276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eb841ba3-a038-45c6-bf82-9cf767d61cb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:43.307988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb841ba3-a038-45c6-bf82-9cf767d61cb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:43.308584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb841ba3-a038-45c6-bf82-9cf767d61cb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:43.309496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb841ba3-a038-45c6-bf82-9cf767d61cb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:43.309967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb841ba3-a038-45c6-bf82-9cf767d61cb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:43.340673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eb841ba3-a038-45c6-bf82-9cf767d61cb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047793 Dec 15 16:27:43.341256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 414/840] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:44.095833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fa10b79d-c0e5-4320-8cab-0a001695b9cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:44.096475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fa10b79d-c0e5-4320-8cab-0a001695b9cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:44.103756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa10b79d-c0e5-4320-8cab-0a001695b9cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:44.104231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa10b79d-c0e5-4320-8cab-0a001695b9cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:44.105096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa10b79d-c0e5-4320-8cab-0a001695b9cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:44.105522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa10b79d-c0e5-4320-8cab-0a001695b9cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:44.246207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fa10b79d-c0e5-4320-8cab-0a001695b9cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:44.256393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fa10b79d-c0e5-4320-8cab-0a001695b9cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.163909 Dec 15 16:27:44.257250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 427/841] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:44.354512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e618c256-92ad-4c87-94c2-cfcb5578772a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:44.355337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e618c256-92ad-4c87-94c2-cfcb5578772a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:44.362176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e618c256-92ad-4c87-94c2-cfcb5578772a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:44.362616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e618c256-92ad-4c87-94c2-cfcb5578772a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:44.363431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e618c256-92ad-4c87-94c2-cfcb5578772a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:44.363860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e618c256-92ad-4c87-94c2-cfcb5578772a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:44.395115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e618c256-92ad-4c87-94c2-cfcb5578772a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044626 Dec 15 16:27:44.395680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 415/842] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:45.274801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6f5b9dad-436b-4f81-a4a7-b264a745fde7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:45.275443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6f5b9dad-436b-4f81-a4a7-b264a745fde7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:45.283273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f5b9dad-436b-4f81-a4a7-b264a745fde7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.283724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f5b9dad-436b-4f81-a4a7-b264a745fde7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.284557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f5b9dad-436b-4f81-a4a7-b264a745fde7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.284986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f5b9dad-436b-4f81-a4a7-b264a745fde7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.407660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ff51fd4b-0e1b-4e35-a995-daa7dffbcaec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:45.408531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ff51fd4b-0e1b-4e35-a995-daa7dffbcaec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:45.414980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff51fd4b-0e1b-4e35-a995-daa7dffbcaec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.415537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff51fd4b-0e1b-4e35-a995-daa7dffbcaec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.416335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff51fd4b-0e1b-4e35-a995-daa7dffbcaec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.416836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff51fd4b-0e1b-4e35-a995-daa7dffbcaec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.434707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6f5b9dad-436b-4f81-a4a7-b264a745fde7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:45.444616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6f5b9dad-436b-4f81-a4a7-b264a745fde7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173506 Dec 15 16:27:45.445206 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 428/843] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:45.449270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ff51fd4b-0e1b-4e35-a995-daa7dffbcaec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045866 Dec 15 16:27:45.449862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 416/844] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:27:46.461245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-80e3fa31-bfde-4391-b8f6-e7588bb44f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:46.462082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-80e3fa31-bfde-4391-b8f6-e7588bb44f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:46.467351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ff3eb2b5-68eb-4196-ac14-fbe3f514ff7b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:46.467959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ff3eb2b5-68eb-4196-ac14-fbe3f514ff7b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:46.470355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-80e3fa31-bfde-4391-b8f6-e7588bb44f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:46.470802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-80e3fa31-bfde-4391-b8f6-e7588bb44f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:46.471593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-80e3fa31-bfde-4391-b8f6-e7588bb44f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:46.472021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-80e3fa31-bfde-4391-b8f6-e7588bb44f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:46.474571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff3eb2b5-68eb-4196-ac14-fbe3f514ff7b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:46.475016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff3eb2b5-68eb-4196-ac14-fbe3f514ff7b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:46.475795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff3eb2b5-68eb-4196-ac14-fbe3f514ff7b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:46.476212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff3eb2b5-68eb-4196-ac14-fbe3f514ff7b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:46.504919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-80e3fa31-bfde-4391-b8f6-e7588bb44f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048168 Dec 15 16:27:46.505734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 429/845] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:46.616059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ff3eb2b5-68eb-4196-ac14-fbe3f514ff7b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:46.624263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ff3eb2b5-68eb-4196-ac14-fbe3f514ff7b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.161027 Dec 15 16:27:46.624896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 417/846] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:46 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:47.517215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-394fb29a-9dad-4e95-9979-3115b9c0927d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:47.518037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-394fb29a-9dad-4e95-9979-3115b9c0927d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:47.524868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-394fb29a-9dad-4e95-9979-3115b9c0927d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:47.525311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-394fb29a-9dad-4e95-9979-3115b9c0927d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:47.526104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-394fb29a-9dad-4e95-9979-3115b9c0927d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:47.526538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-394fb29a-9dad-4e95-9979-3115b9c0927d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:47.561060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-394fb29a-9dad-4e95-9979-3115b9c0927d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047623 Dec 15 16:27:47.561973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 430/847] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:47.647227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e4605b1a-d8e6-43db-926a-7ae67d78245f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:47.648589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e4605b1a-d8e6-43db-926a-7ae67d78245f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:47.659873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4605b1a-d8e6-43db-926a-7ae67d78245f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:47.660726 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4605b1a-d8e6-43db-926a-7ae67d78245f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:47.662034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4605b1a-d8e6-43db-926a-7ae67d78245f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:47.662815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4605b1a-d8e6-43db-926a-7ae67d78245f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:47.808057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e4605b1a-d8e6-43db-926a-7ae67d78245f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:47.816974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e4605b1a-d8e6-43db-926a-7ae67d78245f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176946 Dec 15 16:27:47.817570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 418/848] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:48.576029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7f662a7f-7c8c-4beb-9c1f-43590c36c2ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:48.576989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7f662a7f-7c8c-4beb-9c1f-43590c36c2ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:48.583862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f662a7f-7c8c-4beb-9c1f-43590c36c2ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:48.584304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f662a7f-7c8c-4beb-9c1f-43590c36c2ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:48.585129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f662a7f-7c8c-4beb-9c1f-43590c36c2ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:48.585551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f662a7f-7c8c-4beb-9c1f-43590c36c2ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:48.616093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7f662a7f-7c8c-4beb-9c1f-43590c36c2ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045691 Dec 15 16:27:48.616712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 431/849] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:48 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:48.834784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4f630f4b-3d6d-401e-8170-cc105949b2f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:48.835370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4f630f4b-3d6d-401e-8170-cc105949b2f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:48.842461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f630f4b-3d6d-401e-8170-cc105949b2f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:48.842872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f630f4b-3d6d-401e-8170-cc105949b2f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:48.843713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f630f4b-3d6d-401e-8170-cc105949b2f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:48.844140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f630f4b-3d6d-401e-8170-cc105949b2f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:49.252158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4f630f4b-3d6d-401e-8170-cc105949b2f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:49.260602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4f630f4b-3d6d-401e-8170-cc105949b2f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.429462 Dec 15 16:27:49.261187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 419/850] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:49.628291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-349e95cf-be11-44e1-971f-78869359df3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:49.629213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-349e95cf-be11-44e1-971f-78869359df3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:49.635888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-349e95cf-be11-44e1-971f-78869359df3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:49.636452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-349e95cf-be11-44e1-971f-78869359df3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:49.637593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-349e95cf-be11-44e1-971f-78869359df3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:49.638030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-349e95cf-be11-44e1-971f-78869359df3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:49.668632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-349e95cf-be11-44e1-971f-78869359df3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043892 Dec 15 16:27:49.669220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 432/851] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:50.279598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-650b57dc-a0b1-4862-be40-48f245a1cbd9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:50.280239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-650b57dc-a0b1-4862-be40-48f245a1cbd9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:50.287930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-650b57dc-a0b1-4862-be40-48f245a1cbd9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:50.288379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-650b57dc-a0b1-4862-be40-48f245a1cbd9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:50.289294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-650b57dc-a0b1-4862-be40-48f245a1cbd9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:50.289827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-650b57dc-a0b1-4862-be40-48f245a1cbd9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:50.431733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-650b57dc-a0b1-4862-be40-48f245a1cbd9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:50.440553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-650b57dc-a0b1-4862-be40-48f245a1cbd9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165030 Dec 15 16:27:50.441156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 420/852] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:50 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:50.682252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ba614e16-51f6-441a-b28d-310515daf71c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:50.684266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ba614e16-51f6-441a-b28d-310515daf71c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:50.691181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba614e16-51f6-441a-b28d-310515daf71c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:50.691634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba614e16-51f6-441a-b28d-310515daf71c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:50.692466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba614e16-51f6-441a-b28d-310515daf71c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:50.692938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba614e16-51f6-441a-b28d-310515daf71c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:50.725579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ba614e16-51f6-441a-b28d-310515daf71c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049113 Dec 15 16:27:50.726149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 433/853] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:51.458638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8b618ca0-765a-4248-ac9a-3e2fc447c7c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:51.459295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8b618ca0-765a-4248-ac9a-3e2fc447c7c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:51.467204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b618ca0-765a-4248-ac9a-3e2fc447c7c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:51.467641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b618ca0-765a-4248-ac9a-3e2fc447c7c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:51.468442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b618ca0-765a-4248-ac9a-3e2fc447c7c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:51.468886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b618ca0-765a-4248-ac9a-3e2fc447c7c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:51.612613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8b618ca0-765a-4248-ac9a-3e2fc447c7c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:51.620910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8b618ca0-765a-4248-ac9a-3e2fc447c7c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165861 Dec 15 16:27:51.621680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 421/854] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:51.736881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7de45b5a-b66a-4e74-b5a3-0782e41ece3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:51.737698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7de45b5a-b66a-4e74-b5a3-0782e41ece3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:51.744963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7de45b5a-b66a-4e74-b5a3-0782e41ece3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:51.745416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7de45b5a-b66a-4e74-b5a3-0782e41ece3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:51.746202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7de45b5a-b66a-4e74-b5a3-0782e41ece3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:51.746659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7de45b5a-b66a-4e74-b5a3-0782e41ece3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:51.778011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7de45b5a-b66a-4e74-b5a3-0782e41ece3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045033 Dec 15 16:27:51.778597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 434/855] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:52.638753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-98770851-393a-4371-af30-3e0eb36d5c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:52.639396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-98770851-393a-4371-af30-3e0eb36d5c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:52.646151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-98770851-393a-4371-af30-3e0eb36d5c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:52.646598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-98770851-393a-4371-af30-3e0eb36d5c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:52.647402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-98770851-393a-4371-af30-3e0eb36d5c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:52.647824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-98770851-393a-4371-af30-3e0eb36d5c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:52.791034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-98770851-393a-4371-af30-3e0eb36d5c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:52.791309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-68661422-226a-4c55-8cdc-b1851682853d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:52.792263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-68661422-226a-4c55-8cdc-b1851682853d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:52.802057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68661422-226a-4c55-8cdc-b1851682853d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:52.802385 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-98770851-393a-4371-af30-3e0eb36d5c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.167112 Dec 15 16:27:52.802603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68661422-226a-4c55-8cdc-b1851682853d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:52.807795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 422/856] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:52.807918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68661422-226a-4c55-8cdc-b1851682853d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:52.807918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68661422-226a-4c55-8cdc-b1851682853d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:52.835783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-68661422-226a-4c55-8cdc-b1851682853d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049673 Dec 15 16:27:52.836352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 435/857] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:53.821398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e39fb622-7549-4fc7-89ab-60cd30692193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:53.822008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e39fb622-7549-4fc7-89ab-60cd30692193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:53.829722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e39fb622-7549-4fc7-89ab-60cd30692193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:53.830179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e39fb622-7549-4fc7-89ab-60cd30692193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:53.830984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e39fb622-7549-4fc7-89ab-60cd30692193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:53.831598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e39fb622-7549-4fc7-89ab-60cd30692193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:53.847368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5799d985-9c23-4491-a02b-659ed59535e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:53.848277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5799d985-9c23-4491-a02b-659ed59535e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:53.854824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5799d985-9c23-4491-a02b-659ed59535e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:53.855354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5799d985-9c23-4491-a02b-659ed59535e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:53.856582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5799d985-9c23-4491-a02b-659ed59535e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:53.856991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5799d985-9c23-4491-a02b-659ed59535e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:53.891264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5799d985-9c23-4491-a02b-659ed59535e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047647 Dec 15 16:27:53.891842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 436/858] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:53.985651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e39fb622-7549-4fc7-89ab-60cd30692193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:53.994405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e39fb622-7549-4fc7-89ab-60cd30692193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176602 Dec 15 16:27:53.994997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 423/859] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:53 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:54.904871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4cde4f85-2247-4593-861c-1b42527319b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:54.905807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4cde4f85-2247-4593-861c-1b42527319b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:54.912852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cde4f85-2247-4593-861c-1b42527319b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:54.913304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cde4f85-2247-4593-861c-1b42527319b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:54.914107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cde4f85-2247-4593-861c-1b42527319b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:54.914533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cde4f85-2247-4593-861c-1b42527319b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:54.951397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4cde4f85-2247-4593-861c-1b42527319b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050653 Dec 15 16:27:54.952423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 437/860] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:55.013404 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-57945f80-3113-4747-9d3a-be0ab0b2fd08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:55.014266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-57945f80-3113-4747-9d3a-be0ab0b2fd08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:55.021289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57945f80-3113-4747-9d3a-be0ab0b2fd08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:55.021733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57945f80-3113-4747-9d3a-be0ab0b2fd08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:55.022520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57945f80-3113-4747-9d3a-be0ab0b2fd08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:55.022948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57945f80-3113-4747-9d3a-be0ab0b2fd08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:55.176321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-57945f80-3113-4747-9d3a-be0ab0b2fd08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:55.185321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-57945f80-3113-4747-9d3a-be0ab0b2fd08 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.177315 Dec 15 16:27:55.185927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 424/861] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:27:55.963764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6a907564-99d2-4b3d-bc2c-d2dd897b3018 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:55.964834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6a907564-99d2-4b3d-bc2c-d2dd897b3018 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:55.972072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a907564-99d2-4b3d-bc2c-d2dd897b3018 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:55.972574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a907564-99d2-4b3d-bc2c-d2dd897b3018 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:55.973363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a907564-99d2-4b3d-bc2c-d2dd897b3018 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:55.973794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a907564-99d2-4b3d-bc2c-d2dd897b3018 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:56.005406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6a907564-99d2-4b3d-bc2c-d2dd897b3018 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045382 Dec 15 16:27:56.005964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 438/862] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:56.203054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9177e924-02bd-4d41-99bb-82d01fa6ab89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:56.203669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9177e924-02bd-4d41-99bb-82d01fa6ab89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:56.210337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9177e924-02bd-4d41-99bb-82d01fa6ab89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:56.210776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9177e924-02bd-4d41-99bb-82d01fa6ab89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:56.211557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9177e924-02bd-4d41-99bb-82d01fa6ab89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:56.211985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9177e924-02bd-4d41-99bb-82d01fa6ab89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:56.411728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9177e924-02bd-4d41-99bb-82d01fa6ab89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:56.421487 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9177e924-02bd-4d41-99bb-82d01fa6ab89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.222456 Dec 15 16:27:56.422087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 425/863] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:57.019175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3fba20c6-425c-4b71-9239-0b40d85f73e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:57.020123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3fba20c6-425c-4b71-9239-0b40d85f73e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:57.026631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fba20c6-425c-4b71-9239-0b40d85f73e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:57.027084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fba20c6-425c-4b71-9239-0b40d85f73e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:57.027888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fba20c6-425c-4b71-9239-0b40d85f73e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:57.028320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fba20c6-425c-4b71-9239-0b40d85f73e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:57.065963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3fba20c6-425c-4b71-9239-0b40d85f73e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051087 Dec 15 16:27:57.066685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 439/864] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:57.440679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b1baa69d-e3e7-463f-b173-47aadcefecbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:57.441291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b1baa69d-e3e7-463f-b173-47aadcefecbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:57.448005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1baa69d-e3e7-463f-b173-47aadcefecbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:57.448470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1baa69d-e3e7-463f-b173-47aadcefecbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:57.449259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1baa69d-e3e7-463f-b173-47aadcefecbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:57.449688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1baa69d-e3e7-463f-b173-47aadcefecbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:57.591665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b1baa69d-e3e7-463f-b173-47aadcefecbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:57.603623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b1baa69d-e3e7-463f-b173-47aadcefecbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166402 Dec 15 16:27:57.604517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 426/865] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:58.081943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cad4f45a-8d69-4cf1-81eb-35d17cec85af tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:58.083231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cad4f45a-8d69-4cf1-81eb-35d17cec85af tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:58.092494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cad4f45a-8d69-4cf1-81eb-35d17cec85af tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:58.093010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cad4f45a-8d69-4cf1-81eb-35d17cec85af tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:58.093812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cad4f45a-8d69-4cf1-81eb-35d17cec85af tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:58.094236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cad4f45a-8d69-4cf1-81eb-35d17cec85af tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:58.125327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cad4f45a-8d69-4cf1-81eb-35d17cec85af tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048477 Dec 15 16:27:58.125902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 440/866] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:58.624353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2bcf936b-1044-4320-8831-9a773dba5f5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:58.625156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2bcf936b-1044-4320-8831-9a773dba5f5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:58.631900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2bcf936b-1044-4320-8831-9a773dba5f5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:58.632323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2bcf936b-1044-4320-8831-9a773dba5f5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:58.633175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2bcf936b-1044-4320-8831-9a773dba5f5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:58.633611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2bcf936b-1044-4320-8831-9a773dba5f5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:58.793237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2bcf936b-1044-4320-8831-9a773dba5f5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:58.802137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2bcf936b-1044-4320-8831-9a773dba5f5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.182751 Dec 15 16:27:58.802746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 427/867] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:59.133682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:27:59.133970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:27:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:27:59.137517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-62de0c2e-d9e9-4662-a737-ab542dca8d91 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:59.138423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-62de0c2e-d9e9-4662-a737-ab542dca8d91 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:59.145634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62de0c2e-d9e9-4662-a737-ab542dca8d91 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:59.146080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62de0c2e-d9e9-4662-a737-ab542dca8d91 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:59.146876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62de0c2e-d9e9-4662-a737-ab542dca8d91 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:59.147283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62de0c2e-d9e9-4662-a737-ab542dca8d91 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:59.184081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-62de0c2e-d9e9-4662-a737-ab542dca8d91 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050248 Dec 15 16:27:59.184716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 441/868] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:59.821098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4cc48ac6-8011-4855-8b75-2b2db1964f93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:59.821726 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4cc48ac6-8011-4855-8b75-2b2db1964f93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:59.829369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cc48ac6-8011-4855-8b75-2b2db1964f93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:59.829823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cc48ac6-8011-4855-8b75-2b2db1964f93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:59.830611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cc48ac6-8011-4855-8b75-2b2db1964f93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:59.831048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cc48ac6-8011-4855-8b75-2b2db1964f93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:59.990608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4cc48ac6-8011-4855-8b75-2b2db1964f93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:00.001737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4cc48ac6-8011-4855-8b75-2b2db1964f93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.184974 Dec 15 16:28:00.002484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 428/869] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:59 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:00.196476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c5d079bb-a4d5-4fa0-b20d-595c82ded39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:00.198437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c5d079bb-a4d5-4fa0-b20d-595c82ded39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:00.208137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c5d079bb-a4d5-4fa0-b20d-595c82ded39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:00.208568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c5d079bb-a4d5-4fa0-b20d-595c82ded39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:00.209634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c5d079bb-a4d5-4fa0-b20d-595c82ded39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:00.210105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c5d079bb-a4d5-4fa0-b20d-595c82ded39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:00.242071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c5d079bb-a4d5-4fa0-b20d-595c82ded39b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049449 Dec 15 16:28:00.242635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 442/870] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:01.019786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0e431e98-ca57-4c52-a404-201e2b9a4acf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:01.020570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0e431e98-ca57-4c52-a404-201e2b9a4acf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:01.029324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e431e98-ca57-4c52-a404-201e2b9a4acf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:01.029936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e431e98-ca57-4c52-a404-201e2b9a4acf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:01.030808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e431e98-ca57-4c52-a404-201e2b9a4acf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:01.031369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e431e98-ca57-4c52-a404-201e2b9a4acf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:01.183103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0e431e98-ca57-4c52-a404-201e2b9a4acf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:01.196726 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0e431e98-ca57-4c52-a404-201e2b9a4acf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.180780 Dec 15 16:28:01.197608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 429/871] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:01.254690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-702d55cd-e8f5-41c7-b12b-e72d64a60148 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:01.255594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-702d55cd-e8f5-41c7-b12b-e72d64a60148 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:01.262466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-702d55cd-e8f5-41c7-b12b-e72d64a60148 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:01.262914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-702d55cd-e8f5-41c7-b12b-e72d64a60148 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:01.263729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-702d55cd-e8f5-41c7-b12b-e72d64a60148 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:01.264156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-702d55cd-e8f5-41c7-b12b-e72d64a60148 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:01.293925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-702d55cd-e8f5-41c7-b12b-e72d64a60148 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043090 Dec 15 16:28:01.294402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 443/872] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:02.215745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6a0938ea-e3ab-42e7-8120-5b9bee01ef1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:02.216466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6a0938ea-e3ab-42e7-8120-5b9bee01ef1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:02.223912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a0938ea-e3ab-42e7-8120-5b9bee01ef1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:02.224356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a0938ea-e3ab-42e7-8120-5b9bee01ef1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:02.225216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a0938ea-e3ab-42e7-8120-5b9bee01ef1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:02.225644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a0938ea-e3ab-42e7-8120-5b9bee01ef1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:02.305255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0e7afc54-2af9-44db-8f41-1599c5e3e6b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:02.306212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0e7afc54-2af9-44db-8f41-1599c5e3e6b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:02.313867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e7afc54-2af9-44db-8f41-1599c5e3e6b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:02.314317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e7afc54-2af9-44db-8f41-1599c5e3e6b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:02.315115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e7afc54-2af9-44db-8f41-1599c5e3e6b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:02.315573 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e7afc54-2af9-44db-8f41-1599c5e3e6b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:02.347575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0e7afc54-2af9-44db-8f41-1599c5e3e6b2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046031 Dec 15 16:28:02.348371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 444/873] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:28:02.366122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6a0938ea-e3ab-42e7-8120-5b9bee01ef1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:02.374165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6a0938ea-e3ab-42e7-8120-5b9bee01ef1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.162516 Dec 15 16:28:02.374630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 430/874] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:03.359346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6704f878-9d82-4130-8006-09679356ccb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:03.360272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6704f878-9d82-4130-8006-09679356ccb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:03.366616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6704f878-9d82-4130-8006-09679356ccb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:03.367081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6704f878-9d82-4130-8006-09679356ccb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:03.367869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6704f878-9d82-4130-8006-09679356ccb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:03.368676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6704f878-9d82-4130-8006-09679356ccb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:03.391373 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-041235bd-fb9c-4973-9c52-b6b9b9c0bf9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:03.392685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-041235bd-fb9c-4973-9c52-b6b9b9c0bf9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:03.399281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-041235bd-fb9c-4973-9c52-b6b9b9c0bf9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:03.399731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-041235bd-fb9c-4973-9c52-b6b9b9c0bf9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:03.400608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-041235bd-fb9c-4973-9c52-b6b9b9c0bf9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:03.401022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-041235bd-fb9c-4973-9c52-b6b9b9c0bf9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:03.402841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6704f878-9d82-4130-8006-09679356ccb5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047276 Dec 15 16:28:03.403656 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 445/875] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:03.554288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-041235bd-fb9c-4973-9c52-b6b9b9c0bf9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:03.562378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-041235bd-fb9c-4973-9c52-b6b9b9c0bf9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174804 Dec 15 16:28:03.562953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 431/876] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:03 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:04.415368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6aebe470-d032-4219-a3bc-dcb598929194 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:04.416375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6aebe470-d032-4219-a3bc-dcb598929194 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:04.425693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6aebe470-d032-4219-a3bc-dcb598929194 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:04.426140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6aebe470-d032-4219-a3bc-dcb598929194 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:04.426937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6aebe470-d032-4219-a3bc-dcb598929194 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:04.427370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6aebe470-d032-4219-a3bc-dcb598929194 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:04.458704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6aebe470-d032-4219-a3bc-dcb598929194 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047248 Dec 15 16:28:04.459306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 446/877] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:04.581104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2349f0c8-3200-43c5-91cc-595bfda16bc0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:04.581739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2349f0c8-3200-43c5-91cc-595bfda16bc0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:04.588523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2349f0c8-3200-43c5-91cc-595bfda16bc0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:04.588969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2349f0c8-3200-43c5-91cc-595bfda16bc0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:04.589768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2349f0c8-3200-43c5-91cc-595bfda16bc0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:04.590254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2349f0c8-3200-43c5-91cc-595bfda16bc0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:04.741492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2349f0c8-3200-43c5-91cc-595bfda16bc0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:04.750544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2349f0c8-3200-43c5-91cc-595bfda16bc0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174323 Dec 15 16:28:04.751173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 432/878] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:05.470169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-217bd70d-395b-4610-ba61-a3569f3c7b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:05.471016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-217bd70d-395b-4610-ba61-a3569f3c7b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:05.477697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-217bd70d-395b-4610-ba61-a3569f3c7b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:05.478147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-217bd70d-395b-4610-ba61-a3569f3c7b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:05.478991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-217bd70d-395b-4610-ba61-a3569f3c7b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:05.479392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-217bd70d-395b-4610-ba61-a3569f3c7b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:05.509815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-217bd70d-395b-4610-ba61-a3569f3c7b96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043531 Dec 15 16:28:05.510343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 447/879] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:05.770827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-78113b0e-391b-4d1c-af16-9cecc6523ab8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:05.771407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-78113b0e-391b-4d1c-af16-9cecc6523ab8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:05.778114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78113b0e-391b-4d1c-af16-9cecc6523ab8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:05.778565 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78113b0e-391b-4d1c-af16-9cecc6523ab8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:05.779365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78113b0e-391b-4d1c-af16-9cecc6523ab8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:05.779803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78113b0e-391b-4d1c-af16-9cecc6523ab8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:05.939283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-78113b0e-391b-4d1c-af16-9cecc6523ab8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:05.951267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-78113b0e-391b-4d1c-af16-9cecc6523ab8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.184295 Dec 15 16:28:05.952030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 433/880] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:06.522355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8556ccd4-da5b-4b82-83a4-8d0d92dafa24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:06.523159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8556ccd4-da5b-4b82-83a4-8d0d92dafa24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:06.529799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8556ccd4-da5b-4b82-83a4-8d0d92dafa24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:06.530268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8556ccd4-da5b-4b82-83a4-8d0d92dafa24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:06.531033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8556ccd4-da5b-4b82-83a4-8d0d92dafa24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:06.531464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8556ccd4-da5b-4b82-83a4-8d0d92dafa24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:06.562644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8556ccd4-da5b-4b82-83a4-8d0d92dafa24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044208 Dec 15 16:28:06.563210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 448/881] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:07.074104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2c7221ee-785a-421e-b582-20f50db8df18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:07.074716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2c7221ee-785a-421e-b582-20f50db8df18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:07.081660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c7221ee-785a-421e-b582-20f50db8df18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:07.082107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c7221ee-785a-421e-b582-20f50db8df18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:07.082905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c7221ee-785a-421e-b582-20f50db8df18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:07.083339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c7221ee-785a-421e-b582-20f50db8df18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:07.234569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2c7221ee-785a-421e-b582-20f50db8df18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:07.244145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2c7221ee-785a-421e-b582-20f50db8df18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.277537 Dec 15 16:28:07.244763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 434/882] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:07.575462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c67d35f2-592b-4d5c-a371-55d3575ffd6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:07.576358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c67d35f2-592b-4d5c-a371-55d3575ffd6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:07.583449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c67d35f2-592b-4d5c-a371-55d3575ffd6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:07.583892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c67d35f2-592b-4d5c-a371-55d3575ffd6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:07.584790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c67d35f2-592b-4d5c-a371-55d3575ffd6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:07.585213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c67d35f2-592b-4d5c-a371-55d3575ffd6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:07.616749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c67d35f2-592b-4d5c-a371-55d3575ffd6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044986 Dec 15 16:28:07.617358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 449/883] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:08.261645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-53414bfc-8a60-4b45-9b89-f8d80ed1b069 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:08.262223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-53414bfc-8a60-4b45-9b89-f8d80ed1b069 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:08.269784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53414bfc-8a60-4b45-9b89-f8d80ed1b069 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.270220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53414bfc-8a60-4b45-9b89-f8d80ed1b069 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.271003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53414bfc-8a60-4b45-9b89-f8d80ed1b069 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.271432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53414bfc-8a60-4b45-9b89-f8d80ed1b069 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.424620 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-53414bfc-8a60-4b45-9b89-f8d80ed1b069 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:08.437743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-53414bfc-8a60-4b45-9b89-f8d80ed1b069 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.179763 Dec 15 16:28:08.438895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 435/884] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:08.629876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e7cda9b-c0da-48f8-bade-6a5f3fffb0f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:08.630784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1e7cda9b-c0da-48f8-bade-6a5f3fffb0f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:08.637764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e7cda9b-c0da-48f8-bade-6a5f3fffb0f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.638215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e7cda9b-c0da-48f8-bade-6a5f3fffb0f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.639446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e7cda9b-c0da-48f8-bade-6a5f3fffb0f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.640216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e7cda9b-c0da-48f8-bade-6a5f3fffb0f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.677967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1e7cda9b-c0da-48f8-bade-6a5f3fffb0f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052251 Dec 15 16:28:08.678767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 450/885] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:09.457073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4edcd96d-b365-4b52-9242-67c53da99f84 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:09.457645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4edcd96d-b365-4b52-9242-67c53da99f84 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:09.464596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4edcd96d-b365-4b52-9242-67c53da99f84 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:09.465041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4edcd96d-b365-4b52-9242-67c53da99f84 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:09.465825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4edcd96d-b365-4b52-9242-67c53da99f84 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:09.466256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4edcd96d-b365-4b52-9242-67c53da99f84 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:09.617722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4edcd96d-b365-4b52-9242-67c53da99f84 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:09.629063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4edcd96d-b365-4b52-9242-67c53da99f84 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.175587 Dec 15 16:28:09.629844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 436/886] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:09.690363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2142d040-a0a1-4b6d-a4ce-c910fafbff59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:09.691363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2142d040-a0a1-4b6d-a4ce-c910fafbff59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:09.698084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2142d040-a0a1-4b6d-a4ce-c910fafbff59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:09.698528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2142d040-a0a1-4b6d-a4ce-c910fafbff59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:09.699345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2142d040-a0a1-4b6d-a4ce-c910fafbff59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:09.699803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2142d040-a0a1-4b6d-a4ce-c910fafbff59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:09.730668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2142d040-a0a1-4b6d-a4ce-c910fafbff59 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044069 Dec 15 16:28:09.731138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 451/887] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:10.651210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6a4e5127-64bd-4d01-81c5-ff7838d598f0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:10.651845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6a4e5127-64bd-4d01-81c5-ff7838d598f0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:10.658772 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a4e5127-64bd-4d01-81c5-ff7838d598f0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.659570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a4e5127-64bd-4d01-81c5-ff7838d598f0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.660414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a4e5127-64bd-4d01-81c5-ff7838d598f0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.660884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a4e5127-64bd-4d01-81c5-ff7838d598f0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.742780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-46d8a8a6-cb34-4b08-bc1c-497d24fe3689 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:10.744063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-46d8a8a6-cb34-4b08-bc1c-497d24fe3689 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:10.750887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-46d8a8a6-cb34-4b08-bc1c-497d24fe3689 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.751321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-46d8a8a6-cb34-4b08-bc1c-497d24fe3689 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.752519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-46d8a8a6-cb34-4b08-bc1c-497d24fe3689 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.753595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-46d8a8a6-cb34-4b08-bc1c-497d24fe3689 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.786917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-46d8a8a6-cb34-4b08-bc1c-497d24fe3689 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047927 Dec 15 16:28:10.787519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 452/888] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:10.808530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6a4e5127-64bd-4d01-81c5-ff7838d598f0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:10.816561 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6a4e5127-64bd-4d01-81c5-ff7838d598f0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169021 Dec 15 16:28:10.817143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 437/889] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:11.799529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a4f12bb8-21ab-4339-bb19-dff237915f0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:11.800465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a4f12bb8-21ab-4339-bb19-dff237915f0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:11.807164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a4f12bb8-21ab-4339-bb19-dff237915f0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.807539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a4f12bb8-21ab-4339-bb19-dff237915f0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.808321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a4f12bb8-21ab-4339-bb19-dff237915f0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.808779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a4f12bb8-21ab-4339-bb19-dff237915f0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.834499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1bec857e-78cf-4ec6-bca9-6352c222577d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:11.835108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1bec857e-78cf-4ec6-bca9-6352c222577d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:11.838449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a4f12bb8-21ab-4339-bb19-dff237915f0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043033 Dec 15 16:28:11.839003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 453/890] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:11.841537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1bec857e-78cf-4ec6-bca9-6352c222577d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.841990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1bec857e-78cf-4ec6-bca9-6352c222577d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.842784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1bec857e-78cf-4ec6-bca9-6352c222577d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.843216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1bec857e-78cf-4ec6-bca9-6352c222577d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.997121 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1bec857e-78cf-4ec6-bca9-6352c222577d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:12.007112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1bec857e-78cf-4ec6-bca9-6352c222577d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176344 Dec 15 16:28:12.008166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 438/891] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:11 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:12.850666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c9cc6af7-cd2f-4639-97b7-5f12c1af8139 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:12.851607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c9cc6af7-cd2f-4639-97b7-5f12c1af8139 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:12.858484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9cc6af7-cd2f-4639-97b7-5f12c1af8139 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:12.858916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9cc6af7-cd2f-4639-97b7-5f12c1af8139 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:12.859701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9cc6af7-cd2f-4639-97b7-5f12c1af8139 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:12.860126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9cc6af7-cd2f-4639-97b7-5f12c1af8139 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:12.890812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c9cc6af7-cd2f-4639-97b7-5f12c1af8139 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044075 Dec 15 16:28:12.891391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 454/892] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:13.025768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aee83b27-1795-4bf7-a18b-7f3cafcbf1d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:13.028379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aee83b27-1795-4bf7-a18b-7f3cafcbf1d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:13.033295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aee83b27-1795-4bf7-a18b-7f3cafcbf1d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.033748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aee83b27-1795-4bf7-a18b-7f3cafcbf1d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.034547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aee83b27-1795-4bf7-a18b-7f3cafcbf1d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.035082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aee83b27-1795-4bf7-a18b-7f3cafcbf1d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.185905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aee83b27-1795-4bf7-a18b-7f3cafcbf1d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:13.194149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aee83b27-1795-4bf7-a18b-7f3cafcbf1d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172230 Dec 15 16:28:13.194742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 439/893] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:13.902931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a9df04fc-47f7-4e92-93ce-5c6c09c8bb27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:13.903827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a9df04fc-47f7-4e92-93ce-5c6c09c8bb27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:13.910743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9df04fc-47f7-4e92-93ce-5c6c09c8bb27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.911155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9df04fc-47f7-4e92-93ce-5c6c09c8bb27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.911969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9df04fc-47f7-4e92-93ce-5c6c09c8bb27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.912398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9df04fc-47f7-4e92-93ce-5c6c09c8bb27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.945284 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a9df04fc-47f7-4e92-93ce-5c6c09c8bb27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046095 Dec 15 16:28:13.945867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 455/894] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:14.211923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4c9b7664-f61e-4b06-8f41-cb233da15f6a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:14.212505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4c9b7664-f61e-4b06-8f41-cb233da15f6a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:14.219294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c9b7664-f61e-4b06-8f41-cb233da15f6a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:14.219742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c9b7664-f61e-4b06-8f41-cb233da15f6a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:14.220574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c9b7664-f61e-4b06-8f41-cb233da15f6a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:14.221009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c9b7664-f61e-4b06-8f41-cb233da15f6a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:14.364765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4c9b7664-f61e-4b06-8f41-cb233da15f6a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:14.373072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4c9b7664-f61e-4b06-8f41-cb233da15f6a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165005 Dec 15 16:28:14.373653 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 440/895] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:14.958531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-21b15044-6cf1-41de-80a8-82888a156535 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:14.959452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-21b15044-6cf1-41de-80a8-82888a156535 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:14.966328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21b15044-6cf1-41de-80a8-82888a156535 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:14.966781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21b15044-6cf1-41de-80a8-82888a156535 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:14.967587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21b15044-6cf1-41de-80a8-82888a156535 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:14.968026 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21b15044-6cf1-41de-80a8-82888a156535 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:15.000736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-21b15044-6cf1-41de-80a8-82888a156535 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046082 Dec 15 16:28:15.001482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 456/896] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:15.391063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c74a144e-b2bd-43e2-a009-4889d4e3fbd0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:15.391802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c74a144e-b2bd-43e2-a009-4889d4e3fbd0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:15.399712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c74a144e-b2bd-43e2-a009-4889d4e3fbd0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:15.400162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c74a144e-b2bd-43e2-a009-4889d4e3fbd0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:15.401051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c74a144e-b2bd-43e2-a009-4889d4e3fbd0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:15.401494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c74a144e-b2bd-43e2-a009-4889d4e3fbd0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:15.561111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c74a144e-b2bd-43e2-a009-4889d4e3fbd0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:15.575097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c74a144e-b2bd-43e2-a009-4889d4e3fbd0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.187555 Dec 15 16:28:15.576183 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 441/897] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:16.013735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d4779f56-e9f2-4358-b027-fd6ff3267070 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:16.014657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d4779f56-e9f2-4358-b027-fd6ff3267070 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:16.022415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4779f56-e9f2-4358-b027-fd6ff3267070 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:16.022881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4779f56-e9f2-4358-b027-fd6ff3267070 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:16.023704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4779f56-e9f2-4358-b027-fd6ff3267070 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:16.024136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4779f56-e9f2-4358-b027-fd6ff3267070 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:16.059055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d4779f56-e9f2-4358-b027-fd6ff3267070 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049268 Dec 15 16:28:16.059660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 457/898] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:16 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:16.593571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-750ed3a8-ea53-4349-91b6-200efb1b9c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:16.594286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-750ed3a8-ea53-4349-91b6-200efb1b9c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:16.601731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-750ed3a8-ea53-4349-91b6-200efb1b9c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:16.602180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-750ed3a8-ea53-4349-91b6-200efb1b9c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:16.602988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-750ed3a8-ea53-4349-91b6-200efb1b9c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:16.603423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-750ed3a8-ea53-4349-91b6-200efb1b9c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:16.757134 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-750ed3a8-ea53-4349-91b6-200efb1b9c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:16.765705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-750ed3a8-ea53-4349-91b6-200efb1b9c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.175868 Dec 15 16:28:16.766315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 442/899] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:16 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:28:17.071332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-286e48db-2ba4-4a45-96b4-f71033101cac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:17.072284 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-286e48db-2ba4-4a45-96b4-f71033101cac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:17.079190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-286e48db-2ba4-4a45-96b4-f71033101cac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:17.079639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-286e48db-2ba4-4a45-96b4-f71033101cac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:17.080460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-286e48db-2ba4-4a45-96b4-f71033101cac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:17.080928 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-286e48db-2ba4-4a45-96b4-f71033101cac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:17.116604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-286e48db-2ba4-4a45-96b4-f71033101cac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049150 Dec 15 16:28:17.117216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 458/900] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:17.783976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b6a5fdc7-3658-4968-b291-a287bca0ff1f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:17.784680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b6a5fdc7-3658-4968-b291-a287bca0ff1f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:17.791674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6a5fdc7-3658-4968-b291-a287bca0ff1f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:17.792090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6a5fdc7-3658-4968-b291-a287bca0ff1f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:17.792943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6a5fdc7-3658-4968-b291-a287bca0ff1f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:17.793372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6a5fdc7-3658-4968-b291-a287bca0ff1f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:17.946271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b6a5fdc7-3658-4968-b291-a287bca0ff1f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:17.954481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b6a5fdc7-3658-4968-b291-a287bca0ff1f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174163 Dec 15 16:28:17.955078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 443/901] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:17 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:18.132114 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4fb8f05b-8082-4321-8023-33df532acfe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:18.132965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4fb8f05b-8082-4321-8023-33df532acfe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:18.139714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4fb8f05b-8082-4321-8023-33df532acfe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:18.140174 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4fb8f05b-8082-4321-8023-33df532acfe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:18.141008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4fb8f05b-8082-4321-8023-33df532acfe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:18.141433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4fb8f05b-8082-4321-8023-33df532acfe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:18.174689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4fb8f05b-8082-4321-8023-33df532acfe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046994 Dec 15 16:28:18.175270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 459/902] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:18.974667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fc4479d2-2a9d-4b02-beaf-98f323e17a5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:18.975320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fc4479d2-2a9d-4b02-beaf-98f323e17a5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:18.982037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fc4479d2-2a9d-4b02-beaf-98f323e17a5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:18.982483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fc4479d2-2a9d-4b02-beaf-98f323e17a5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:18.983243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fc4479d2-2a9d-4b02-beaf-98f323e17a5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:18.983673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fc4479d2-2a9d-4b02-beaf-98f323e17a5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:19.131517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fc4479d2-2a9d-4b02-beaf-98f323e17a5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:19.140007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fc4479d2-2a9d-4b02-beaf-98f323e17a5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171228 Dec 15 16:28:19.140649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 444/903] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:19.189106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a5ca5dc6-286a-41c8-902b-ab29f7b53c89 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:19.190718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a5ca5dc6-286a-41c8-902b-ab29f7b53c89 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:19.200161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5ca5dc6-286a-41c8-902b-ab29f7b53c89 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:19.200651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5ca5dc6-286a-41c8-902b-ab29f7b53c89 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:19.201480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5ca5dc6-286a-41c8-902b-ab29f7b53c89 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:19.201920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5ca5dc6-286a-41c8-902b-ab29f7b53c89 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:19.236167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a5ca5dc6-286a-41c8-902b-ab29f7b53c89 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052720 Dec 15 16:28:19.236711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 460/904] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:20.157587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5c7aa0f0-ff17-4cdb-a7a1-c1aebf8643b0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:20.158165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5c7aa0f0-ff17-4cdb-a7a1-c1aebf8643b0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:20.164943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c7aa0f0-ff17-4cdb-a7a1-c1aebf8643b0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.165361 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c7aa0f0-ff17-4cdb-a7a1-c1aebf8643b0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.166200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c7aa0f0-ff17-4cdb-a7a1-c1aebf8643b0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.166636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c7aa0f0-ff17-4cdb-a7a1-c1aebf8643b0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.252220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-28894083-5045-4896-8fa7-f56447ad9aa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:20.254081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-28894083-5045-4896-8fa7-f56447ad9aa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:20.266385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28894083-5045-4896-8fa7-f56447ad9aa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.267008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28894083-5045-4896-8fa7-f56447ad9aa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.267928 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28894083-5045-4896-8fa7-f56447ad9aa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.268502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28894083-5045-4896-8fa7-f56447ad9aa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.302787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-28894083-5045-4896-8fa7-f56447ad9aa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057256 Dec 15 16:28:20.303421 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 461/905] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:20.341219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5c7aa0f0-ff17-4cdb-a7a1-c1aebf8643b0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:20.350400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5c7aa0f0-ff17-4cdb-a7a1-c1aebf8643b0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.196452 Dec 15 16:28:20.351013 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 445/906] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:20 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:21.315668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b16476d9-f63a-4091-8181-653066012877 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:21.316781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b16476d9-f63a-4091-8181-653066012877 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:21.323602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16476d9-f63a-4091-8181-653066012877 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.324058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16476d9-f63a-4091-8181-653066012877 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.324914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16476d9-f63a-4091-8181-653066012877 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.325353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16476d9-f63a-4091-8181-653066012877 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.359313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b16476d9-f63a-4091-8181-653066012877 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047924 Dec 15 16:28:21.359907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 462/907] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:21.367229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a96a1616-e090-4989-9dc3-9b0a7f69e7a4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:21.367832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a96a1616-e090-4989-9dc3-9b0a7f69e7a4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:21.379179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a96a1616-e090-4989-9dc3-9b0a7f69e7a4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.380015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a96a1616-e090-4989-9dc3-9b0a7f69e7a4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.381466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a96a1616-e090-4989-9dc3-9b0a7f69e7a4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.382129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a96a1616-e090-4989-9dc3-9b0a7f69e7a4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.535356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a96a1616-e090-4989-9dc3-9b0a7f69e7a4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:21.543408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a96a1616-e090-4989-9dc3-9b0a7f69e7a4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.180082 Dec 15 16:28:21.543963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 446/908] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:22.372534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-11f352d2-9153-409c-b8c9-c877a4b15c3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:22.373434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-11f352d2-9153-409c-b8c9-c877a4b15c3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:22.380800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11f352d2-9153-409c-b8c9-c877a4b15c3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:22.381245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11f352d2-9153-409c-b8c9-c877a4b15c3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:22.382035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11f352d2-9153-409c-b8c9-c877a4b15c3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:22.382454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11f352d2-9153-409c-b8c9-c877a4b15c3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:22.414550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-11f352d2-9153-409c-b8c9-c877a4b15c3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046082 Dec 15 16:28:22.415147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 463/909] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:22.561185 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0e58d087-e01a-4889-a740-7ffd2d439162 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:22.562467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0e58d087-e01a-4889-a740-7ffd2d439162 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:22.569660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e58d087-e01a-4889-a740-7ffd2d439162 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:22.570084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e58d087-e01a-4889-a740-7ffd2d439162 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:22.570883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e58d087-e01a-4889-a740-7ffd2d439162 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:22.571315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0e58d087-e01a-4889-a740-7ffd2d439162 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:22.734001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0e58d087-e01a-4889-a740-7ffd2d439162 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:22.744942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0e58d087-e01a-4889-a740-7ffd2d439162 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.187027 Dec 15 16:28:22.745540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 447/910] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:22 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:23.427510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a01a32a3-701b-434c-8bc4-198c2a25d45c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:23.428389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a01a32a3-701b-434c-8bc4-198c2a25d45c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:23.435456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a01a32a3-701b-434c-8bc4-198c2a25d45c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:23.435902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a01a32a3-701b-434c-8bc4-198c2a25d45c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:23.436799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a01a32a3-701b-434c-8bc4-198c2a25d45c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:23.437388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a01a32a3-701b-434c-8bc4-198c2a25d45c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:23.474025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a01a32a3-701b-434c-8bc4-198c2a25d45c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050398 Dec 15 16:28:23.474877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 464/911] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:23.763719 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d34aa5e0-1d74-4cc0-8771-7d6e9b96788a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:23.764306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d34aa5e0-1d74-4cc0-8771-7d6e9b96788a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:23.772455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d34aa5e0-1d74-4cc0-8771-7d6e9b96788a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:23.772912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d34aa5e0-1d74-4cc0-8771-7d6e9b96788a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:23.773712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d34aa5e0-1d74-4cc0-8771-7d6e9b96788a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:23.774151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d34aa5e0-1d74-4cc0-8771-7d6e9b96788a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:23.924720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d34aa5e0-1d74-4cc0-8771-7d6e9b96788a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:23.933335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d34aa5e0-1d74-4cc0-8771-7d6e9b96788a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173722 Dec 15 16:28:23.934006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 448/912] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:23 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:24.486366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d1e409af-8920-4e84-86fa-487e814f7be3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:24.487279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d1e409af-8920-4e84-86fa-487e814f7be3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:24.494615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1e409af-8920-4e84-86fa-487e814f7be3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:24.495070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1e409af-8920-4e84-86fa-487e814f7be3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:24.495911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1e409af-8920-4e84-86fa-487e814f7be3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:24.496347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1e409af-8920-4e84-86fa-487e814f7be3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:24.530492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d1e409af-8920-4e84-86fa-487e814f7be3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048047 Dec 15 16:28:24.531184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 465/913] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:24.951966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-694647f7-47cd-4c5a-97e9-316541865de0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:24.952640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-694647f7-47cd-4c5a-97e9-316541865de0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:24.959689 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-694647f7-47cd-4c5a-97e9-316541865de0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:24.960125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-694647f7-47cd-4c5a-97e9-316541865de0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:24.960970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-694647f7-47cd-4c5a-97e9-316541865de0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:24.961403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-694647f7-47cd-4c5a-97e9-316541865de0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:25.111729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-694647f7-47cd-4c5a-97e9-316541865de0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:25.120780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-694647f7-47cd-4c5a-97e9-316541865de0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172592 Dec 15 16:28:25.121566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 449/914] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:25.544008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a623f489-9069-440c-8e18-ed01e05552b9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:25.544931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a623f489-9069-440c-8e18-ed01e05552b9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:25.551941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a623f489-9069-440c-8e18-ed01e05552b9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:25.552419 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a623f489-9069-440c-8e18-ed01e05552b9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:25.553244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a623f489-9069-440c-8e18-ed01e05552b9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:25.553673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a623f489-9069-440c-8e18-ed01e05552b9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:25.587794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a623f489-9069-440c-8e18-ed01e05552b9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047643 Dec 15 16:28:25.588375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 466/915] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:26.141996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cc0f383a-e542-4baf-abc6-ad23ce2eb2ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:26.142830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cc0f383a-e542-4baf-abc6-ad23ce2eb2ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:26.150776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc0f383a-e542-4baf-abc6-ad23ce2eb2ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:26.151288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc0f383a-e542-4baf-abc6-ad23ce2eb2ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:26.152086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc0f383a-e542-4baf-abc6-ad23ce2eb2ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:26.152544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc0f383a-e542-4baf-abc6-ad23ce2eb2ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:26.296475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cc0f383a-e542-4baf-abc6-ad23ce2eb2ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:26.305095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cc0f383a-e542-4baf-abc6-ad23ce2eb2ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168851 Dec 15 16:28:26.305686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 450/916] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:26 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:26.601515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e82dc941-32f9-4f99-b8db-a77e91ba4a5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:26.602430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e82dc941-32f9-4f99-b8db-a77e91ba4a5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:26.609557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e82dc941-32f9-4f99-b8db-a77e91ba4a5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:26.610011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e82dc941-32f9-4f99-b8db-a77e91ba4a5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:26.610803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e82dc941-32f9-4f99-b8db-a77e91ba4a5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:26.611244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e82dc941-32f9-4f99-b8db-a77e91ba4a5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:26.642767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e82dc941-32f9-4f99-b8db-a77e91ba4a5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045105 Dec 15 16:28:26.643339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 467/917] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:27.324355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-92b3dbc9-7dcc-4fe2-897e-094dadd5aeb6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:27.325116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-92b3dbc9-7dcc-4fe2-897e-094dadd5aeb6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:27.332246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b3dbc9-7dcc-4fe2-897e-094dadd5aeb6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:27.332775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b3dbc9-7dcc-4fe2-897e-094dadd5aeb6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:27.333812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b3dbc9-7dcc-4fe2-897e-094dadd5aeb6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:27.334197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b3dbc9-7dcc-4fe2-897e-094dadd5aeb6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:27.481790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-92b3dbc9-7dcc-4fe2-897e-094dadd5aeb6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:27.489571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-92b3dbc9-7dcc-4fe2-897e-094dadd5aeb6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169019 Dec 15 16:28:27.490150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 451/918] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:27.655746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5b7a8e05-0ff7-4199-aa79-2b12e233753a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:27.656727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5b7a8e05-0ff7-4199-aa79-2b12e233753a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:27.664853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b7a8e05-0ff7-4199-aa79-2b12e233753a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:27.665494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b7a8e05-0ff7-4199-aa79-2b12e233753a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:27.666433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b7a8e05-0ff7-4199-aa79-2b12e233753a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:27.667004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b7a8e05-0ff7-4199-aa79-2b12e233753a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:27.700127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5b7a8e05-0ff7-4199-aa79-2b12e233753a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048356 Dec 15 16:28:27.700667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 468/919] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:28.508194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4b76156c-366a-4848-aae7-0b5d23634396 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:28.508877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4b76156c-366a-4848-aae7-0b5d23634396 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:28.515823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b76156c-366a-4848-aae7-0b5d23634396 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:28.516263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b76156c-366a-4848-aae7-0b5d23634396 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:28.517084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b76156c-366a-4848-aae7-0b5d23634396 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:28.517514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b76156c-366a-4848-aae7-0b5d23634396 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:28.667538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4b76156c-366a-4848-aae7-0b5d23634396 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:28.678826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4b76156c-366a-4848-aae7-0b5d23634396 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174458 Dec 15 16:28:28.679597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 452/920] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:28.711741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6d94608c-7cf8-4704-8898-a95de0c6afe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:28.712691 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6d94608c-7cf8-4704-8898-a95de0c6afe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:28.719466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d94608c-7cf8-4704-8898-a95de0c6afe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:28.719935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d94608c-7cf8-4704-8898-a95de0c6afe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:28.720757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d94608c-7cf8-4704-8898-a95de0c6afe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:28.721187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d94608c-7cf8-4704-8898-a95de0c6afe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:28.751888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6d94608c-7cf8-4704-8898-a95de0c6afe5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043889 Dec 15 16:28:28.752476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 469/921] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:29.701402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b21a075e-d625-425e-885a-faee2dd5e57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:29.702008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b21a075e-d625-425e-885a-faee2dd5e57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:29.708315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b21a075e-d625-425e-885a-faee2dd5e57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:29.708791 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b21a075e-d625-425e-885a-faee2dd5e57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:29.709587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b21a075e-d625-425e-885a-faee2dd5e57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:29.710023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b21a075e-d625-425e-885a-faee2dd5e57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:29.764930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f2b5351f-fa43-48da-ad98-aa5ee0ac7297 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:29.765836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f2b5351f-fa43-48da-ad98-aa5ee0ac7297 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:29.773551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2b5351f-fa43-48da-ad98-aa5ee0ac7297 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:29.773993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2b5351f-fa43-48da-ad98-aa5ee0ac7297 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:29.774833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2b5351f-fa43-48da-ad98-aa5ee0ac7297 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:29.775266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2b5351f-fa43-48da-ad98-aa5ee0ac7297 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:29.807246 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f2b5351f-fa43-48da-ad98-aa5ee0ac7297 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046111 Dec 15 16:28:29.808045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 470/922] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:29.859963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b21a075e-d625-425e-885a-faee2dd5e57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:29.869041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b21a075e-d625-425e-885a-faee2dd5e57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171747 Dec 15 16:28:29.870015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 453/923] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:30.821149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c15abdfb-d94e-445e-8427-9970dcb4696e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:30.822045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c15abdfb-d94e-445e-8427-9970dcb4696e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:30.828929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c15abdfb-d94e-445e-8427-9970dcb4696e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:30.829381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c15abdfb-d94e-445e-8427-9970dcb4696e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:30.830167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c15abdfb-d94e-445e-8427-9970dcb4696e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:30.830597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c15abdfb-d94e-445e-8427-9970dcb4696e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:30.860712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c15abdfb-d94e-445e-8427-9970dcb4696e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044023 Dec 15 16:28:30.861266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 471/924] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:30.890184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-57c1512a-71ce-4357-b5b4-483ee192f968 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:30.891117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-57c1512a-71ce-4357-b5b4-483ee192f968 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:30.900707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57c1512a-71ce-4357-b5b4-483ee192f968 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:30.901388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57c1512a-71ce-4357-b5b4-483ee192f968 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:30.902606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57c1512a-71ce-4357-b5b4-483ee192f968 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:30.903318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57c1512a-71ce-4357-b5b4-483ee192f968 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:31.053430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-57c1512a-71ce-4357-b5b4-483ee192f968 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:31.061139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-57c1512a-71ce-4357-b5b4-483ee192f968 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.177014 Dec 15 16:28:31.061725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 454/925] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:30 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:31.876222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-748c3d52-290d-4ff0-929f-71d4c264411b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:31.877091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-748c3d52-290d-4ff0-929f-71d4c264411b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:31.885757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-748c3d52-290d-4ff0-929f-71d4c264411b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:31.886357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-748c3d52-290d-4ff0-929f-71d4c264411b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:31.887293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-748c3d52-290d-4ff0-929f-71d4c264411b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:31.887871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-748c3d52-290d-4ff0-929f-71d4c264411b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:31.919441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-748c3d52-290d-4ff0-929f-71d4c264411b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049558 Dec 15 16:28:31.919987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 472/926] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:32.079312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-812a07aa-f473-428b-a773-95ccb1b19c75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:32.079921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-812a07aa-f473-428b-a773-95ccb1b19c75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:32.087055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-812a07aa-f473-428b-a773-95ccb1b19c75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:32.087510 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-812a07aa-f473-428b-a773-95ccb1b19c75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:32.088295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-812a07aa-f473-428b-a773-95ccb1b19c75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:32.088798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-812a07aa-f473-428b-a773-95ccb1b19c75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:32.242886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-812a07aa-f473-428b-a773-95ccb1b19c75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:32.251681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-812a07aa-f473-428b-a773-95ccb1b19c75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176096 Dec 15 16:28:32.252268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 455/927] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:32.934108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-14d3c68a-0fad-4dca-ba49-d41b1378d607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:32.934864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-14d3c68a-0fad-4dca-ba49-d41b1378d607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:32.941279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14d3c68a-0fad-4dca-ba49-d41b1378d607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:32.941727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14d3c68a-0fad-4dca-ba49-d41b1378d607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:32.942514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14d3c68a-0fad-4dca-ba49-d41b1378d607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:32.943065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14d3c68a-0fad-4dca-ba49-d41b1378d607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:32.975435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-14d3c68a-0fad-4dca-ba49-d41b1378d607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045712 Dec 15 16:28:32.976033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 473/928] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:33.270924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7b64f7bf-6736-412a-8a59-3a7be9cb1eef tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:33.271532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7b64f7bf-6736-412a-8a59-3a7be9cb1eef tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:33.280205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b64f7bf-6736-412a-8a59-3a7be9cb1eef tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:33.280697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b64f7bf-6736-412a-8a59-3a7be9cb1eef tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:33.281563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b64f7bf-6736-412a-8a59-3a7be9cb1eef tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:33.282000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b64f7bf-6736-412a-8a59-3a7be9cb1eef tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:33.441177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7b64f7bf-6736-412a-8a59-3a7be9cb1eef tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:33.450389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7b64f7bf-6736-412a-8a59-3a7be9cb1eef tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.183797 Dec 15 16:28:33.450976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 456/929] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:33.987441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ded56ca4-ba01-4099-8ad3-9f71bfea8e7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:33.988231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ded56ca4-ba01-4099-8ad3-9f71bfea8e7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:33.996869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ded56ca4-ba01-4099-8ad3-9f71bfea8e7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:33.997502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ded56ca4-ba01-4099-8ad3-9f71bfea8e7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:33.998504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ded56ca4-ba01-4099-8ad3-9f71bfea8e7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:33.998942 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ded56ca4-ba01-4099-8ad3-9f71bfea8e7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:34.031371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ded56ca4-ba01-4099-8ad3-9f71bfea8e7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047800 Dec 15 16:28:34.031957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 474/930] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:34.468612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c984fbaa-91a8-429d-8984-dbf773ec8323 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:34.469247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c984fbaa-91a8-429d-8984-dbf773ec8323 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:34.476233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c984fbaa-91a8-429d-8984-dbf773ec8323 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:34.476705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c984fbaa-91a8-429d-8984-dbf773ec8323 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:34.477467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c984fbaa-91a8-429d-8984-dbf773ec8323 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:34.477922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c984fbaa-91a8-429d-8984-dbf773ec8323 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:34.623781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c984fbaa-91a8-429d-8984-dbf773ec8323 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:34.632005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c984fbaa-91a8-429d-8984-dbf773ec8323 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.167108 Dec 15 16:28:34.632614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 457/931] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:34 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:35.043659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-005dcaad-4f2c-4ede-a76f-c571a4215b6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:35.044587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-005dcaad-4f2c-4ede-a76f-c571a4215b6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:35.051183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-005dcaad-4f2c-4ede-a76f-c571a4215b6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:35.051605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-005dcaad-4f2c-4ede-a76f-c571a4215b6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:35.052568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-005dcaad-4f2c-4ede-a76f-c571a4215b6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:35.053295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-005dcaad-4f2c-4ede-a76f-c571a4215b6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:35.086709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-005dcaad-4f2c-4ede-a76f-c571a4215b6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046642 Dec 15 16:28:35.087398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 475/932] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:35.649530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6600647e-205c-4b64-b8a7-011b28ac5533 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:35.650146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6600647e-205c-4b64-b8a7-011b28ac5533 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:35.657037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6600647e-205c-4b64-b8a7-011b28ac5533 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:35.657487 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6600647e-205c-4b64-b8a7-011b28ac5533 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:35.658293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6600647e-205c-4b64-b8a7-011b28ac5533 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:35.658719 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6600647e-205c-4b64-b8a7-011b28ac5533 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:35.805431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6600647e-205c-4b64-b8a7-011b28ac5533 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:35.816422 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6600647e-205c-4b64-b8a7-011b28ac5533 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170317 Dec 15 16:28:35.817451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 458/933] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:36.100474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d3b19325-fda2-4780-a17d-2e4f8fe0ad41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:36.101316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d3b19325-fda2-4780-a17d-2e4f8fe0ad41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:36.108380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3b19325-fda2-4780-a17d-2e4f8fe0ad41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:36.108869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3b19325-fda2-4780-a17d-2e4f8fe0ad41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:36.109668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3b19325-fda2-4780-a17d-2e4f8fe0ad41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:36.110095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3b19325-fda2-4780-a17d-2e4f8fe0ad41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:36.144994 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d3b19325-fda2-4780-a17d-2e4f8fe0ad41 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049869 Dec 15 16:28:36.145674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 476/934] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:36.835232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-47038080-3429-4fc3-b8dc-81e237a3c27c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:36.835885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-47038080-3429-4fc3-b8dc-81e237a3c27c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:36.843206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47038080-3429-4fc3-b8dc-81e237a3c27c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:36.843657 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47038080-3429-4fc3-b8dc-81e237a3c27c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:36.844473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47038080-3429-4fc3-b8dc-81e237a3c27c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:36.844925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47038080-3429-4fc3-b8dc-81e237a3c27c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:36.992566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-47038080-3429-4fc3-b8dc-81e237a3c27c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:37.000541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-47038080-3429-4fc3-b8dc-81e237a3c27c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169006 Dec 15 16:28:37.001115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 459/935] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:36 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:37.162806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a2ced3ff-5107-44e7-aa81-30f10d217e28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:37.163704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a2ced3ff-5107-44e7-aa81-30f10d217e28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:37.170701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2ced3ff-5107-44e7-aa81-30f10d217e28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:37.171150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2ced3ff-5107-44e7-aa81-30f10d217e28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:37.171940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2ced3ff-5107-44e7-aa81-30f10d217e28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:37.172369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2ced3ff-5107-44e7-aa81-30f10d217e28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:37.202638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a2ced3ff-5107-44e7-aa81-30f10d217e28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043640 Dec 15 16:28:37.203194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 477/936] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:38.018975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-42e6b887-4d0c-4782-b9cb-034a45f18c57 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:38.019549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-42e6b887-4d0c-4782-b9cb-034a45f18c57 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:38.026658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e6b887-4d0c-4782-b9cb-034a45f18c57 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:38.027108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e6b887-4d0c-4782-b9cb-034a45f18c57 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:38.027907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e6b887-4d0c-4782-b9cb-034a45f18c57 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:38.028339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e6b887-4d0c-4782-b9cb-034a45f18c57 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:38.186308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-42e6b887-4d0c-4782-b9cb-034a45f18c57 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:38.196260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-42e6b887-4d0c-4782-b9cb-034a45f18c57 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.181227 Dec 15 16:28:38.197016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 460/937] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:38.215516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fcb15d3e-949b-4733-acb6-832c6906eccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:38.216464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fcb15d3e-949b-4733-acb6-832c6906eccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:38.223354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcb15d3e-949b-4733-acb6-832c6906eccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:38.223796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcb15d3e-949b-4733-acb6-832c6906eccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:38.224655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcb15d3e-949b-4733-acb6-832c6906eccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:38.225087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fcb15d3e-949b-4733-acb6-832c6906eccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:38.261445 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fcb15d3e-949b-4733-acb6-832c6906eccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050539 Dec 15 16:28:38.262031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 478/938] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:39.214798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2b45d13a-8015-4478-8a2b-6e08bdd60e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:39.215422 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2b45d13a-8015-4478-8a2b-6e08bdd60e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:39.223103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b45d13a-8015-4478-8a2b-6e08bdd60e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:39.223560 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b45d13a-8015-4478-8a2b-6e08bdd60e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:39.224361 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b45d13a-8015-4478-8a2b-6e08bdd60e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:39.224810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b45d13a-8015-4478-8a2b-6e08bdd60e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:39.272481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-23f66898-0181-4cd7-86a9-e9f927422a0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:39.273401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-23f66898-0181-4cd7-86a9-e9f927422a0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:39.280145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23f66898-0181-4cd7-86a9-e9f927422a0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:39.280630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23f66898-0181-4cd7-86a9-e9f927422a0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:39.281424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23f66898-0181-4cd7-86a9-e9f927422a0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:39.281848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23f66898-0181-4cd7-86a9-e9f927422a0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:39.315259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-23f66898-0181-4cd7-86a9-e9f927422a0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046486 Dec 15 16:28:39.315943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 479/939] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:39.377397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2b45d13a-8015-4478-8a2b-6e08bdd60e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:39.385257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2b45d13a-8015-4478-8a2b-6e08bdd60e77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174569 Dec 15 16:28:39.385847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 461/940] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:40.327526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-48f28574-5f65-4812-95aa-68cb1ffbbc88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:40.328462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-48f28574-5f65-4812-95aa-68cb1ffbbc88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:40.335515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-48f28574-5f65-4812-95aa-68cb1ffbbc88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:40.335964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-48f28574-5f65-4812-95aa-68cb1ffbbc88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:40.337029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-48f28574-5f65-4812-95aa-68cb1ffbbc88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:40.337465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-48f28574-5f65-4812-95aa-68cb1ffbbc88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:40.372800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-48f28574-5f65-4812-95aa-68cb1ffbbc88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048895 Dec 15 16:28:40.373335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 480/941] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:40.402827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-319ccdaa-15d5-4f47-b10e-8bdaff6f4ed6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:40.403530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-319ccdaa-15d5-4f47-b10e-8bdaff6f4ed6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:40.410312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-319ccdaa-15d5-4f47-b10e-8bdaff6f4ed6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:40.410845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-319ccdaa-15d5-4f47-b10e-8bdaff6f4ed6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:40.411732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-319ccdaa-15d5-4f47-b10e-8bdaff6f4ed6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:40.411988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-319ccdaa-15d5-4f47-b10e-8bdaff6f4ed6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:40.574073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-319ccdaa-15d5-4f47-b10e-8bdaff6f4ed6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:40.590696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-319ccdaa-15d5-4f47-b10e-8bdaff6f4ed6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.191510 Dec 15 16:28:40.591303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 462/942] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:40 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:41.385267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-36c402dc-75f8-474d-830d-4bee17607a87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:41.386141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-36c402dc-75f8-474d-830d-4bee17607a87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:41.392902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36c402dc-75f8-474d-830d-4bee17607a87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:41.393323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36c402dc-75f8-474d-830d-4bee17607a87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:41.394142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36c402dc-75f8-474d-830d-4bee17607a87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:41.394566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36c402dc-75f8-474d-830d-4bee17607a87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:41.427755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-36c402dc-75f8-474d-830d-4bee17607a87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046721 Dec 15 16:28:41.428320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 481/943] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:41.609369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c74844d5-6f92-4878-aa6e-f98f433802df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:41.610023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c74844d5-6f92-4878-aa6e-f98f433802df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:41.616915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c74844d5-6f92-4878-aa6e-f98f433802df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:41.617491 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c74844d5-6f92-4878-aa6e-f98f433802df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:41.618419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c74844d5-6f92-4878-aa6e-f98f433802df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:41.618850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c74844d5-6f92-4878-aa6e-f98f433802df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:41.778758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c74844d5-6f92-4878-aa6e-f98f433802df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:41.786742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c74844d5-6f92-4878-aa6e-f98f433802df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.181273 Dec 15 16:28:41.787353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 463/944] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:41 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:42.439874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9654c594-1796-4a1a-b771-5fd3a3949c2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:42.440851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9654c594-1796-4a1a-b771-5fd3a3949c2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:42.448393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9654c594-1796-4a1a-b771-5fd3a3949c2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:42.448873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9654c594-1796-4a1a-b771-5fd3a3949c2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:42.449779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9654c594-1796-4a1a-b771-5fd3a3949c2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:42.450206 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9654c594-1796-4a1a-b771-5fd3a3949c2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:42.487080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9654c594-1796-4a1a-b771-5fd3a3949c2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051041 Dec 15 16:28:42.487689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 482/945] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:42.804868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-53161480-4647-4677-9175-b370be76b900 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:42.805446 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-53161480-4647-4677-9175-b370be76b900 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:42.814771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53161480-4647-4677-9175-b370be76b900 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:42.815624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53161480-4647-4677-9175-b370be76b900 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:42.817062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53161480-4647-4677-9175-b370be76b900 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:42.817667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53161480-4647-4677-9175-b370be76b900 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:43.009827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-53161480-4647-4677-9175-b370be76b900 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:43.018294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-53161480-4647-4677-9175-b370be76b900 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.217316 Dec 15 16:28:43.018892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 464/946] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:42 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:28:43.501072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-14a2c4f7-0b36-4e78-a7a8-391d83b91604 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:43.502235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-14a2c4f7-0b36-4e78-a7a8-391d83b91604 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:43.509811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14a2c4f7-0b36-4e78-a7a8-391d83b91604 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:43.510242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14a2c4f7-0b36-4e78-a7a8-391d83b91604 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:43.511117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14a2c4f7-0b36-4e78-a7a8-391d83b91604 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:43.511550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14a2c4f7-0b36-4e78-a7a8-391d83b91604 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:43.543497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-14a2c4f7-0b36-4e78-a7a8-391d83b91604 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047171 Dec 15 16:28:43.544081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 483/947] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:44.036164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-39adf04c-c947-4d02-9f13-efa3890e5126 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:44.036848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-39adf04c-c947-4d02-9f13-efa3890e5126 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:44.045154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39adf04c-c947-4d02-9f13-efa3890e5126 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:44.045896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39adf04c-c947-4d02-9f13-efa3890e5126 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:44.046760 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39adf04c-c947-4d02-9f13-efa3890e5126 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:44.047248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39adf04c-c947-4d02-9f13-efa3890e5126 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:44.219628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-39adf04c-c947-4d02-9f13-efa3890e5126 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:44.228808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-39adf04c-c947-4d02-9f13-efa3890e5126 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.196313 Dec 15 16:28:44.229410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 465/948] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:44.556460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9a0dba54-dd07-42b5-9005-1424b6787629 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:44.558150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9a0dba54-dd07-42b5-9005-1424b6787629 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:44.565039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a0dba54-dd07-42b5-9005-1424b6787629 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:44.565541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a0dba54-dd07-42b5-9005-1424b6787629 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:44.566336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a0dba54-dd07-42b5-9005-1424b6787629 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:44.566768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a0dba54-dd07-42b5-9005-1424b6787629 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:44.601446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9a0dba54-dd07-42b5-9005-1424b6787629 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049473 Dec 15 16:28:44.602043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 484/949] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:45.247525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c9f6c4fb-ce9b-4067-a5c8-be838dbc70d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:45.248124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c9f6c4fb-ce9b-4067-a5c8-be838dbc70d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:45.254876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9f6c4fb-ce9b-4067-a5c8-be838dbc70d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:45.255325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9f6c4fb-ce9b-4067-a5c8-be838dbc70d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:45.256129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9f6c4fb-ce9b-4067-a5c8-be838dbc70d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:45.256593 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9f6c4fb-ce9b-4067-a5c8-be838dbc70d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:45.411502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c9f6c4fb-ce9b-4067-a5c8-be838dbc70d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:45.420164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c9f6c4fb-ce9b-4067-a5c8-be838dbc70d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.177123 Dec 15 16:28:45.420851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 466/950] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:45.614970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-255a5869-d6a2-4a74-bf22-c2e009a449c8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:45.616353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-255a5869-d6a2-4a74-bf22-c2e009a449c8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:45.625379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-255a5869-d6a2-4a74-bf22-c2e009a449c8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:45.625828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-255a5869-d6a2-4a74-bf22-c2e009a449c8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:45.626788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-255a5869-d6a2-4a74-bf22-c2e009a449c8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:45.627529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-255a5869-d6a2-4a74-bf22-c2e009a449c8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:45.662858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-255a5869-d6a2-4a74-bf22-c2e009a449c8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052602 Dec 15 16:28:45.663327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 485/951] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:46.438912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-42a28237-3d37-4a33-8b4e-837dbd68db49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:46.439486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-42a28237-3d37-4a33-8b4e-837dbd68db49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:46.446397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42a28237-3d37-4a33-8b4e-837dbd68db49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:46.446869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42a28237-3d37-4a33-8b4e-837dbd68db49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:46.447717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42a28237-3d37-4a33-8b4e-837dbd68db49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:46.448148 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42a28237-3d37-4a33-8b4e-837dbd68db49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:46.603911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-42a28237-3d37-4a33-8b4e-837dbd68db49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:46.611858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-42a28237-3d37-4a33-8b4e-837dbd68db49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176792 Dec 15 16:28:46.612472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 467/952] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:46 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:46.675837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-520b4073-6c05-4a08-b139-6b04a275b57d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:46.676858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-520b4073-6c05-4a08-b139-6b04a275b57d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:46.684947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-520b4073-6c05-4a08-b139-6b04a275b57d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:46.685720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-520b4073-6c05-4a08-b139-6b04a275b57d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:46.687103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-520b4073-6c05-4a08-b139-6b04a275b57d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:46.687871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-520b4073-6c05-4a08-b139-6b04a275b57d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:46.727988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-520b4073-6c05-4a08-b139-6b04a275b57d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056479 Dec 15 16:28:46.728487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 486/953] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:28:47.633275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8aea97e4-f0dd-4340-88c6-e9c283444bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:47.634350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8aea97e4-f0dd-4340-88c6-e9c283444bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:47.641196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8aea97e4-f0dd-4340-88c6-e9c283444bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:47.641654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8aea97e4-f0dd-4340-88c6-e9c283444bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:47.642501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8aea97e4-f0dd-4340-88c6-e9c283444bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:47.642948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8aea97e4-f0dd-4340-88c6-e9c283444bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:47.739371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-015c6ae2-a220-4106-bace-f6619e6b020c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:47.740285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-015c6ae2-a220-4106-bace-f6619e6b020c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:47.747580 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-015c6ae2-a220-4106-bace-f6619e6b020c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:47.748075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-015c6ae2-a220-4106-bace-f6619e6b020c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:47.748913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-015c6ae2-a220-4106-bace-f6619e6b020c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:47.749350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-015c6ae2-a220-4106-bace-f6619e6b020c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:47.780511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-015c6ae2-a220-4106-bace-f6619e6b020c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044797 Dec 15 16:28:47.781083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 487/954] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:47.788109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8aea97e4-f0dd-4340-88c6-e9c283444bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:47.796067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8aea97e4-f0dd-4340-88c6-e9c283444bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166651 Dec 15 16:28:47.796666 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 468/955] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:48.794081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-95752904-48b8-4b28-a02d-f753ba257735 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:48.795312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-95752904-48b8-4b28-a02d-f753ba257735 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:48.804137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95752904-48b8-4b28-a02d-f753ba257735 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:48.804799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95752904-48b8-4b28-a02d-f753ba257735 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:48.805891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95752904-48b8-4b28-a02d-f753ba257735 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:48.806487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95752904-48b8-4b28-a02d-f753ba257735 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:48.819237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-da10f0b0-28e2-4e5b-a077-a0f4e5e5823f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:48.820139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-da10f0b0-28e2-4e5b-a077-a0f4e5e5823f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:48.827508 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da10f0b0-28e2-4e5b-a077-a0f4e5e5823f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:48.827957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da10f0b0-28e2-4e5b-a077-a0f4e5e5823f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:48.828814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da10f0b0-28e2-4e5b-a077-a0f4e5e5823f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:48.829249 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da10f0b0-28e2-4e5b-a077-a0f4e5e5823f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:48.840620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-95752904-48b8-4b28-a02d-f753ba257735 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051678 Dec 15 16:28:48.841195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 488/956] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:48 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:48.976370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-da10f0b0-28e2-4e5b-a077-a0f4e5e5823f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:48.989152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-da10f0b0-28e2-4e5b-a077-a0f4e5e5823f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174893 Dec 15 16:28:48.989743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 469/957] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:49.853200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1f73ea0b-55a1-40e8-8fc2-4b164ac82766 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:49.854027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1f73ea0b-55a1-40e8-8fc2-4b164ac82766 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:49.860857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f73ea0b-55a1-40e8-8fc2-4b164ac82766 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:49.861299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f73ea0b-55a1-40e8-8fc2-4b164ac82766 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:49.862084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f73ea0b-55a1-40e8-8fc2-4b164ac82766 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:49.862525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f73ea0b-55a1-40e8-8fc2-4b164ac82766 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:49.894778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1f73ea0b-55a1-40e8-8fc2-4b164ac82766 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045913 Dec 15 16:28:49.895577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 489/958] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:50.016804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-655c68da-c1ba-42bd-8e5b-93749480873b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:50.017519 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-655c68da-c1ba-42bd-8e5b-93749480873b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:50.024479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-655c68da-c1ba-42bd-8e5b-93749480873b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:50.025170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-655c68da-c1ba-42bd-8e5b-93749480873b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:50.026198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-655c68da-c1ba-42bd-8e5b-93749480873b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:50.026643 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-655c68da-c1ba-42bd-8e5b-93749480873b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:50.197483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-655c68da-c1ba-42bd-8e5b-93749480873b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:50.205986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-655c68da-c1ba-42bd-8e5b-93749480873b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.193133 Dec 15 16:28:50.206574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 470/959] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:50 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:50.909949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fe849373-4844-4d66-a357-1fdd364ef5c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:50.910931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fe849373-4844-4d66-a357-1fdd364ef5c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:50.919530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe849373-4844-4d66-a357-1fdd364ef5c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:50.919973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe849373-4844-4d66-a357-1fdd364ef5c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:50.920796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe849373-4844-4d66-a357-1fdd364ef5c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:50.921228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe849373-4844-4d66-a357-1fdd364ef5c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:50.958392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fe849373-4844-4d66-a357-1fdd364ef5c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054169 Dec 15 16:28:50.959050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 490/960] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:51.223449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e2ddd8a7-5dc8-47d6-8696-e07c821052ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:51.224042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e2ddd8a7-5dc8-47d6-8696-e07c821052ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:51.231918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e2ddd8a7-5dc8-47d6-8696-e07c821052ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:51.232375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e2ddd8a7-5dc8-47d6-8696-e07c821052ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:51.233227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e2ddd8a7-5dc8-47d6-8696-e07c821052ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:51.233739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e2ddd8a7-5dc8-47d6-8696-e07c821052ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:51.382974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e2ddd8a7-5dc8-47d6-8696-e07c821052ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:51.390951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e2ddd8a7-5dc8-47d6-8696-e07c821052ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171329 Dec 15 16:28:51.391539 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 471/961] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:51.972689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a6ed4569-661e-42cb-bff3-f69a8fb52eeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:51.973595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a6ed4569-661e-42cb-bff3-f69a8fb52eeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:51.981394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6ed4569-661e-42cb-bff3-f69a8fb52eeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:51.981842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6ed4569-661e-42cb-bff3-f69a8fb52eeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:51.982635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6ed4569-661e-42cb-bff3-f69a8fb52eeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:51.983070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6ed4569-661e-42cb-bff3-f69a8fb52eeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:52.015268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a6ed4569-661e-42cb-bff3-f69a8fb52eeb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047968 Dec 15 16:28:52.015854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 491/962] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:52.410959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-34f77afb-b8b8-40e6-8721-232b0acca9df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:52.411607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-34f77afb-b8b8-40e6-8721-232b0acca9df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:52.418861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-34f77afb-b8b8-40e6-8721-232b0acca9df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:52.419305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-34f77afb-b8b8-40e6-8721-232b0acca9df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:52.420104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-34f77afb-b8b8-40e6-8721-232b0acca9df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:52.420580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-34f77afb-b8b8-40e6-8721-232b0acca9df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:52.573659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-34f77afb-b8b8-40e6-8721-232b0acca9df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:52.582036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-34f77afb-b8b8-40e6-8721-232b0acca9df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174732 Dec 15 16:28:52.582630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 472/963] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:53.026481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4b6f440a-bd11-4667-9d5c-1b4afedbe11a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:53.027388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4b6f440a-bd11-4667-9d5c-1b4afedbe11a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:53.033945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b6f440a-bd11-4667-9d5c-1b4afedbe11a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:53.034404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b6f440a-bd11-4667-9d5c-1b4afedbe11a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:53.035188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b6f440a-bd11-4667-9d5c-1b4afedbe11a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:53.035625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b6f440a-bd11-4667-9d5c-1b4afedbe11a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:53.064903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4b6f440a-bd11-4667-9d5c-1b4afedbe11a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042277 Dec 15 16:28:53.065462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 492/964] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:53.599983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8f255ff5-e7e5-49dd-9f3a-576693ca1618 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:53.600702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8f255ff5-e7e5-49dd-9f3a-576693ca1618 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:53.607828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f255ff5-e7e5-49dd-9f3a-576693ca1618 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:53.608269 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f255ff5-e7e5-49dd-9f3a-576693ca1618 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:53.609092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f255ff5-e7e5-49dd-9f3a-576693ca1618 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:53.609520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f255ff5-e7e5-49dd-9f3a-576693ca1618 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:53.753110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8f255ff5-e7e5-49dd-9f3a-576693ca1618 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:53.761296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8f255ff5-e7e5-49dd-9f3a-576693ca1618 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.164937 Dec 15 16:28:53.762151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 473/965] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:53 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:54.077652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f757414b-f2bc-4567-a35c-64904fb4e515 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:54.078759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f757414b-f2bc-4567-a35c-64904fb4e515 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:54.086043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f757414b-f2bc-4567-a35c-64904fb4e515 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:54.086499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f757414b-f2bc-4567-a35c-64904fb4e515 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:54.087334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f757414b-f2bc-4567-a35c-64904fb4e515 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:54.087957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f757414b-f2bc-4567-a35c-64904fb4e515 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:54.119860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f757414b-f2bc-4567-a35c-64904fb4e515 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046467 Dec 15 16:28:54.124216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 493/966] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:54.781110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f41a52d8-e04d-42df-af99-8437bfce28f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:54.781704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f41a52d8-e04d-42df-af99-8437bfce28f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:54.791166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f41a52d8-e04d-42df-af99-8437bfce28f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:54.791916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f41a52d8-e04d-42df-af99-8437bfce28f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:54.792888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f41a52d8-e04d-42df-af99-8437bfce28f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:54.793324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f41a52d8-e04d-42df-af99-8437bfce28f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:54.960154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f41a52d8-e04d-42df-af99-8437bfce28f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:54.972906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f41a52d8-e04d-42df-af99-8437bfce28f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.197026 Dec 15 16:28:54.973933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 474/967] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:54 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:55.131553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-342af076-8685-4b55-9f57-c85202af9504 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:55.132470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-342af076-8685-4b55-9f57-c85202af9504 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:55.139584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-342af076-8685-4b55-9f57-c85202af9504 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:55.140042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-342af076-8685-4b55-9f57-c85202af9504 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:55.140893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-342af076-8685-4b55-9f57-c85202af9504 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:55.141332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-342af076-8685-4b55-9f57-c85202af9504 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:55.176593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-342af076-8685-4b55-9f57-c85202af9504 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048737 Dec 15 16:28:55.177191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 494/968] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:28:55.992100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dba8cf00-594d-400e-9d71-f05305f5f3d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:55.992683 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dba8cf00-594d-400e-9d71-f05305f5f3d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:56.000724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dba8cf00-594d-400e-9d71-f05305f5f3d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:56.001171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dba8cf00-594d-400e-9d71-f05305f5f3d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:56.001963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dba8cf00-594d-400e-9d71-f05305f5f3d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:56.002399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dba8cf00-594d-400e-9d71-f05305f5f3d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:56.170335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dba8cf00-594d-400e-9d71-f05305f5f3d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:56.178830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dba8cf00-594d-400e-9d71-f05305f5f3d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.190412 Dec 15 16:28:56.179475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 475/969] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:56.189598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9b0fd009-d359-43c8-85fe-66ccab9c3311 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:56.191067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9b0fd009-d359-43c8-85fe-66ccab9c3311 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:56.199041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9b0fd009-d359-43c8-85fe-66ccab9c3311 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:56.199497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9b0fd009-d359-43c8-85fe-66ccab9c3311 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:56.200313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9b0fd009-d359-43c8-85fe-66ccab9c3311 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:56.200781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9b0fd009-d359-43c8-85fe-66ccab9c3311 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:56.234831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9b0fd009-d359-43c8-85fe-66ccab9c3311 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049279 Dec 15 16:28:56.235428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 495/970] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:57.198386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0ee39179-214a-4439-ba46-65499fb8e835 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:57.199000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0ee39179-214a-4439-ba46-65499fb8e835 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:57.206206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ee39179-214a-4439-ba46-65499fb8e835 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:57.206641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ee39179-214a-4439-ba46-65499fb8e835 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:57.207476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ee39179-214a-4439-ba46-65499fb8e835 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:57.207926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ee39179-214a-4439-ba46-65499fb8e835 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:57.263416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-690d4ad9-d646-4eb3-a948-8c03e5f50a5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:57.264568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-690d4ad9-d646-4eb3-a948-8c03e5f50a5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:57.271413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-690d4ad9-d646-4eb3-a948-8c03e5f50a5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:57.271858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-690d4ad9-d646-4eb3-a948-8c03e5f50a5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:57.272697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-690d4ad9-d646-4eb3-a948-8c03e5f50a5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:57.273156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-690d4ad9-d646-4eb3-a948-8c03e5f50a5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:57.309509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-690d4ad9-d646-4eb3-a948-8c03e5f50a5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066271 Dec 15 16:28:57.310107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 496/971] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:28:57.389507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0ee39179-214a-4439-ba46-65499fb8e835 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:57.397993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0ee39179-214a-4439-ba46-65499fb8e835 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.203342 Dec 15 16:28:57.398595 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 476/972] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:58.322447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-314466fb-ef92-44d2-b1c0-209b000fb265 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:58.323704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-314466fb-ef92-44d2-b1c0-209b000fb265 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:58.330283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-314466fb-ef92-44d2-b1c0-209b000fb265 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:58.330735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-314466fb-ef92-44d2-b1c0-209b000fb265 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:58.331778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-314466fb-ef92-44d2-b1c0-209b000fb265 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:58.331973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-314466fb-ef92-44d2-b1c0-209b000fb265 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:58.364952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-314466fb-ef92-44d2-b1c0-209b000fb265 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046519 Dec 15 16:28:58.365551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 497/973] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:58.419693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-73f78570-83b6-4a82-b779-08901f95f987 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:58.420784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-73f78570-83b6-4a82-b779-08901f95f987 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:58.431321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73f78570-83b6-4a82-b779-08901f95f987 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:58.432128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73f78570-83b6-4a82-b779-08901f95f987 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:58.433805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73f78570-83b6-4a82-b779-08901f95f987 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:58.434511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-73f78570-83b6-4a82-b779-08901f95f987 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:58.681261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-73f78570-83b6-4a82-b779-08901f95f987 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:58.690906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-73f78570-83b6-4a82-b779-08901f95f987 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.277921 Dec 15 16:28:58.691854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 477/974] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:59.377482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2d340efa-9420-4561-9289-8151d7bb797f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:59.378261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2d340efa-9420-4561-9289-8151d7bb797f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:59.385083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d340efa-9420-4561-9289-8151d7bb797f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:59.385635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d340efa-9420-4561-9289-8151d7bb797f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:59.386436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d340efa-9420-4561-9289-8151d7bb797f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:59.386861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d340efa-9420-4561-9289-8151d7bb797f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:59.419316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2d340efa-9420-4561-9289-8151d7bb797f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045752 Dec 15 16:28:59.419897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 498/975] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:28:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:59.709569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-90d18b24-3a9e-464c-8d57-0ec34c417c32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:59.710228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-90d18b24-3a9e-464c-8d57-0ec34c417c32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:59.717326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-90d18b24-3a9e-464c-8d57-0ec34c417c32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:59.717860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-90d18b24-3a9e-464c-8d57-0ec34c417c32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:59.718705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-90d18b24-3a9e-464c-8d57-0ec34c417c32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:59.719181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-90d18b24-3a9e-464c-8d57-0ec34c417c32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:59.870210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-90d18b24-3a9e-464c-8d57-0ec34c417c32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:59.879991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-90d18b24-3a9e-464c-8d57-0ec34c417c32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174123 Dec 15 16:28:59.880633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 478/976] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:59 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:00.435280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5746eabf-c56a-405e-959b-74f7f0e47976 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:00.436776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5746eabf-c56a-405e-959b-74f7f0e47976 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:00.446901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5746eabf-c56a-405e-959b-74f7f0e47976 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:00.447675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5746eabf-c56a-405e-959b-74f7f0e47976 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:00.449094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5746eabf-c56a-405e-959b-74f7f0e47976 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:00.449865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5746eabf-c56a-405e-959b-74f7f0e47976 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:00.503257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5746eabf-c56a-405e-959b-74f7f0e47976 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074182 Dec 15 16:29:00.504410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 499/977] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:00.898494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4d1239b9-88fc-4f6c-af8b-c76d78df7e90 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:00.899618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4d1239b9-88fc-4f6c-af8b-c76d78df7e90 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:00.907500 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d1239b9-88fc-4f6c-af8b-c76d78df7e90 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:00.908007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d1239b9-88fc-4f6c-af8b-c76d78df7e90 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:00.909130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d1239b9-88fc-4f6c-af8b-c76d78df7e90 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:00.909796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d1239b9-88fc-4f6c-af8b-c76d78df7e90 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:01.074136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4d1239b9-88fc-4f6c-af8b-c76d78df7e90 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:01.085555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4d1239b9-88fc-4f6c-af8b-c76d78df7e90 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.191579 Dec 15 16:29:01.086144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 479/978] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:01.515716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2f01254f-da3d-47f6-a0d9-a62380234a4c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:01.516676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2f01254f-da3d-47f6-a0d9-a62380234a4c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:01.523451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f01254f-da3d-47f6-a0d9-a62380234a4c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:01.523890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f01254f-da3d-47f6-a0d9-a62380234a4c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:01.524709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f01254f-da3d-47f6-a0d9-a62380234a4c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:01.525131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2f01254f-da3d-47f6-a0d9-a62380234a4c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:01.563830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2f01254f-da3d-47f6-a0d9-a62380234a4c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052007 Dec 15 16:29:01.564401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 500/979] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:02.103488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-270259f5-f47f-41e5-8ffb-8af1448eaa82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:02.104149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-270259f5-f47f-41e5-8ffb-8af1448eaa82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:02.111225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-270259f5-f47f-41e5-8ffb-8af1448eaa82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:02.111665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-270259f5-f47f-41e5-8ffb-8af1448eaa82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:02.112492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-270259f5-f47f-41e5-8ffb-8af1448eaa82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:02.112945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-270259f5-f47f-41e5-8ffb-8af1448eaa82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:02.262370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-270259f5-f47f-41e5-8ffb-8af1448eaa82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:02.272171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-270259f5-f47f-41e5-8ffb-8af1448eaa82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172327 Dec 15 16:29:02.272986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 480/980] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:02.575776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2266e22a-cfd2-472c-b3e0-0ea90e64002d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:02.576858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2266e22a-cfd2-472c-b3e0-0ea90e64002d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:02.583471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2266e22a-cfd2-472c-b3e0-0ea90e64002d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:02.583945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2266e22a-cfd2-472c-b3e0-0ea90e64002d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:02.584765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2266e22a-cfd2-472c-b3e0-0ea90e64002d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:02.585196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2266e22a-cfd2-472c-b3e0-0ea90e64002d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:02.616640 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2266e22a-cfd2-472c-b3e0-0ea90e64002d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044716 Dec 15 16:29:02.617229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 501/981] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:02.971998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:29:02.972229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:29:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:29:03.289698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2472dd1d-a538-4cf1-8dcf-7ddbc4a1451b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:03.290393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2472dd1d-a538-4cf1-8dcf-7ddbc4a1451b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:03.297152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2472dd1d-a538-4cf1-8dcf-7ddbc4a1451b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:03.297594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2472dd1d-a538-4cf1-8dcf-7ddbc4a1451b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:03.298400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2472dd1d-a538-4cf1-8dcf-7ddbc4a1451b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:03.298835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2472dd1d-a538-4cf1-8dcf-7ddbc4a1451b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:03.450363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2472dd1d-a538-4cf1-8dcf-7ddbc4a1451b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:03.459030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2472dd1d-a538-4cf1-8dcf-7ddbc4a1451b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173078 Dec 15 16:29:03.459633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 481/982] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:03 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:03.629630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-337d005f-5ad0-4680-93d6-893df1174c78 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:03.630566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-337d005f-5ad0-4680-93d6-893df1174c78 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:03.637678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-337d005f-5ad0-4680-93d6-893df1174c78 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:03.638129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-337d005f-5ad0-4680-93d6-893df1174c78 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:03.638951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-337d005f-5ad0-4680-93d6-893df1174c78 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:03.639389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-337d005f-5ad0-4680-93d6-893df1174c78 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:03.674175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-337d005f-5ad0-4680-93d6-893df1174c78 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048796 Dec 15 16:29:03.674787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 502/983] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:04.477634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7863864f-6bb0-4eb0-b051-18d4ffdc9993 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:04.478262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7863864f-6bb0-4eb0-b051-18d4ffdc9993 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:04.486180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7863864f-6bb0-4eb0-b051-18d4ffdc9993 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:04.486636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7863864f-6bb0-4eb0-b051-18d4ffdc9993 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:04.487476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7863864f-6bb0-4eb0-b051-18d4ffdc9993 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:04.487921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7863864f-6bb0-4eb0-b051-18d4ffdc9993 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:04.645132 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7863864f-6bb0-4eb0-b051-18d4ffdc9993 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:04.654854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7863864f-6bb0-4eb0-b051-18d4ffdc9993 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.180701 Dec 15 16:29:04.657035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 482/984] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:04.687364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f577d145-2619-4164-bb7a-5de2bf3ccdfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:04.688290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f577d145-2619-4164-bb7a-5de2bf3ccdfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:04.696064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f577d145-2619-4164-bb7a-5de2bf3ccdfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:04.696724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f577d145-2619-4164-bb7a-5de2bf3ccdfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:04.697673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f577d145-2619-4164-bb7a-5de2bf3ccdfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:04.698535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f577d145-2619-4164-bb7a-5de2bf3ccdfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:04.729996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f577d145-2619-4164-bb7a-5de2bf3ccdfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046405 Dec 15 16:29:04.730539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 503/985] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:05.679016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-36f4f75d-22ef-4e3b-9d51-9804ed268520 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:05.679932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-36f4f75d-22ef-4e3b-9d51-9804ed268520 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:05.687369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36f4f75d-22ef-4e3b-9d51-9804ed268520 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:05.687843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36f4f75d-22ef-4e3b-9d51-9804ed268520 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:05.688682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36f4f75d-22ef-4e3b-9d51-9804ed268520 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:05.689154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36f4f75d-22ef-4e3b-9d51-9804ed268520 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:05.745152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3484ead8-6e60-4b12-b69f-e8e47eaf201c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:05.746740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3484ead8-6e60-4b12-b69f-e8e47eaf201c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:05.753399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3484ead8-6e60-4b12-b69f-e8e47eaf201c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:05.753848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3484ead8-6e60-4b12-b69f-e8e47eaf201c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:05.754650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3484ead8-6e60-4b12-b69f-e8e47eaf201c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:05.755208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3484ead8-6e60-4b12-b69f-e8e47eaf201c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:05.787471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3484ead8-6e60-4b12-b69f-e8e47eaf201c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047915 Dec 15 16:29:05.788060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 504/986] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:05.855380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-36f4f75d-22ef-4e3b-9d51-9804ed268520 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:05.863019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-36f4f75d-22ef-4e3b-9d51-9804ed268520 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.189543 Dec 15 16:29:05.863599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 483/987] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:06.799683 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-76bc2ca9-f536-4328-a51e-e137d35ff141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:06.800623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-76bc2ca9-f536-4328-a51e-e137d35ff141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:06.807261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76bc2ca9-f536-4328-a51e-e137d35ff141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:06.807712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76bc2ca9-f536-4328-a51e-e137d35ff141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:06.808762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76bc2ca9-f536-4328-a51e-e137d35ff141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:06.809178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76bc2ca9-f536-4328-a51e-e137d35ff141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:06.840068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-76bc2ca9-f536-4328-a51e-e137d35ff141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044214 Dec 15 16:29:06.840799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 505/988] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:06.886167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-22d51296-d687-4653-9999-27338da005be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:06.886759 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-22d51296-d687-4653-9999-27338da005be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:06.893536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-22d51296-d687-4653-9999-27338da005be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:06.894049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-22d51296-d687-4653-9999-27338da005be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:06.894937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-22d51296-d687-4653-9999-27338da005be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:06.895432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-22d51296-d687-4653-9999-27338da005be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:07.055429 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-22d51296-d687-4653-9999-27338da005be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:07.063176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-22d51296-d687-4653-9999-27338da005be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.182682 Dec 15 16:29:07.063751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 484/989] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:07.853094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-065ffa1e-6803-45dc-8ee2-12895fb6cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:07.853902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-065ffa1e-6803-45dc-8ee2-12895fb6cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:07.861602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-065ffa1e-6803-45dc-8ee2-12895fb6cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:07.862194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-065ffa1e-6803-45dc-8ee2-12895fb6cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:07.863231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-065ffa1e-6803-45dc-8ee2-12895fb6cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:07.863687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-065ffa1e-6803-45dc-8ee2-12895fb6cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:07.905893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-065ffa1e-6803-45dc-8ee2-12895fb6cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056715 Dec 15 16:29:07.906467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 506/990] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:08.080461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-60322ddb-6997-4f68-92bd-72a3db36c5b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:08.081118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-60322ddb-6997-4f68-92bd-72a3db36c5b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:08.087798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60322ddb-6997-4f68-92bd-72a3db36c5b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.088244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60322ddb-6997-4f68-92bd-72a3db36c5b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:08.089126 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60322ddb-6997-4f68-92bd-72a3db36c5b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.089641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60322ddb-6997-4f68-92bd-72a3db36c5b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:08.233464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-60322ddb-6997-4f68-92bd-72a3db36c5b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:08.244925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-60322ddb-6997-4f68-92bd-72a3db36c5b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.167758 Dec 15 16:29:08.245656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 485/991] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:08.919658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-020f0872-059d-4760-8917-46df617c4685 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:08.920604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-020f0872-059d-4760-8917-46df617c4685 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:08.927998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-020f0872-059d-4760-8917-46df617c4685 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.928485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-020f0872-059d-4760-8917-46df617c4685 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:08.929272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-020f0872-059d-4760-8917-46df617c4685 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.929706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-020f0872-059d-4760-8917-46df617c4685 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:08.971217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-020f0872-059d-4760-8917-46df617c4685 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055454 Dec 15 16:29:08.971812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 507/992] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:09.263152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b831c91a-bcab-4f60-b0c4-9bfeb9363fdc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:09.263733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b831c91a-bcab-4f60-b0c4-9bfeb9363fdc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:09.270248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b831c91a-bcab-4f60-b0c4-9bfeb9363fdc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:09.270693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b831c91a-bcab-4f60-b0c4-9bfeb9363fdc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:09.271454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b831c91a-bcab-4f60-b0c4-9bfeb9363fdc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:09.271889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b831c91a-bcab-4f60-b0c4-9bfeb9363fdc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:09.419201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b831c91a-bcab-4f60-b0c4-9bfeb9363fdc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:09.431398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b831c91a-bcab-4f60-b0c4-9bfeb9363fdc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171754 Dec 15 16:29:09.432144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 486/993] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:09.984204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5e2c066f-caff-415b-916d-f5cb3c96d0f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:09.985042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5e2c066f-caff-415b-916d-f5cb3c96d0f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:09.991737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e2c066f-caff-415b-916d-f5cb3c96d0f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:09.992166 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e2c066f-caff-415b-916d-f5cb3c96d0f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:09.992951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e2c066f-caff-415b-916d-f5cb3c96d0f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:09.993405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e2c066f-caff-415b-916d-f5cb3c96d0f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:10.025820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5e2c066f-caff-415b-916d-f5cb3c96d0f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045493 Dec 15 16:29:10.026714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 508/994] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:10.450211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c4a5339f-7d39-422c-acb7-ae796b4b6ff7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:10.450874 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c4a5339f-7d39-422c-acb7-ae796b4b6ff7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:10.457504 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c4a5339f-7d39-422c-acb7-ae796b4b6ff7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:10.457943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c4a5339f-7d39-422c-acb7-ae796b4b6ff7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:10.458720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c4a5339f-7d39-422c-acb7-ae796b4b6ff7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:10.459143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c4a5339f-7d39-422c-acb7-ae796b4b6ff7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:10.601608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c4a5339f-7d39-422c-acb7-ae796b4b6ff7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:10.610877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c4a5339f-7d39-422c-acb7-ae796b4b6ff7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.164649 Dec 15 16:29:10.611441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 487/995] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:11.038862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-39ef9ac7-d2cb-4106-90de-f32b005b0362 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:11.039604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-39ef9ac7-d2cb-4106-90de-f32b005b0362 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:11.049357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39ef9ac7-d2cb-4106-90de-f32b005b0362 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:11.049814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39ef9ac7-d2cb-4106-90de-f32b005b0362 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:11.051156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39ef9ac7-d2cb-4106-90de-f32b005b0362 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:11.051596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39ef9ac7-d2cb-4106-90de-f32b005b0362 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:11.092936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-39ef9ac7-d2cb-4106-90de-f32b005b0362 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058577 Dec 15 16:29:11.094449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 509/996] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:11.633755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f1e7d0e2-d3dd-4255-a546-419dfd2b3b18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:11.634349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f1e7d0e2-d3dd-4255-a546-419dfd2b3b18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:11.641100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1e7d0e2-d3dd-4255-a546-419dfd2b3b18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:11.641541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1e7d0e2-d3dd-4255-a546-419dfd2b3b18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:11.642320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1e7d0e2-d3dd-4255-a546-419dfd2b3b18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:11.642745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1e7d0e2-d3dd-4255-a546-419dfd2b3b18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:11.783389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f1e7d0e2-d3dd-4255-a546-419dfd2b3b18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:11.791555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f1e7d0e2-d3dd-4255-a546-419dfd2b3b18 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.161489 Dec 15 16:29:11.792138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 488/997] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:11 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:12.107315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dcce6ac7-1310-4ca1-b996-437f3005adea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:12.108211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dcce6ac7-1310-4ca1-b996-437f3005adea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:12.114957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcce6ac7-1310-4ca1-b996-437f3005adea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:12.115400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcce6ac7-1310-4ca1-b996-437f3005adea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:12.116190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcce6ac7-1310-4ca1-b996-437f3005adea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:12.116651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcce6ac7-1310-4ca1-b996-437f3005adea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:12.148807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dcce6ac7-1310-4ca1-b996-437f3005adea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046851 Dec 15 16:29:12.149374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 510/998] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:12.809594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9aca0696-93c6-4d46-8082-e1265b81a560 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:12.810410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9aca0696-93c6-4d46-8082-e1265b81a560 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:12.817286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9aca0696-93c6-4d46-8082-e1265b81a560 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:12.817736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9aca0696-93c6-4d46-8082-e1265b81a560 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:12.818527 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9aca0696-93c6-4d46-8082-e1265b81a560 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:12.818964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9aca0696-93c6-4d46-8082-e1265b81a560 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:12.972770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9aca0696-93c6-4d46-8082-e1265b81a560 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:12.980572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9aca0696-93c6-4d46-8082-e1265b81a560 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174801 Dec 15 16:29:12.981183 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 489/999] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:12 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:13.163082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1033428a-d54b-4c1e-bcf7-13b817728378 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:13.164390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1033428a-d54b-4c1e-bcf7-13b817728378 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:13.174684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1033428a-d54b-4c1e-bcf7-13b817728378 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:13.175331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1033428a-d54b-4c1e-bcf7-13b817728378 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:13.176657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1033428a-d54b-4c1e-bcf7-13b817728378 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:13.177256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1033428a-d54b-4c1e-bcf7-13b817728378 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:13.210849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1033428a-d54b-4c1e-bcf7-13b817728378 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053120 Dec 15 16:29:13.211407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 511/1000] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:13.999315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2e05f449-ebd4-40d3-83a9-3a4f9e3e9407 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:13.999914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2e05f449-ebd4-40d3-83a9-3a4f9e3e9407 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:14.006804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e05f449-ebd4-40d3-83a9-3a4f9e3e9407 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:14.007284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e05f449-ebd4-40d3-83a9-3a4f9e3e9407 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:14.008076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e05f449-ebd4-40d3-83a9-3a4f9e3e9407 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:14.008535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e05f449-ebd4-40d3-83a9-3a4f9e3e9407 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:14.160463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2e05f449-ebd4-40d3-83a9-3a4f9e3e9407 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:14.168192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2e05f449-ebd4-40d3-83a9-3a4f9e3e9407 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173457 Dec 15 16:29:14.168822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 490/1001] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:14.223592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f154336c-bfc6-42fd-9301-844991cb41dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:14.224495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f154336c-bfc6-42fd-9301-844991cb41dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:14.233372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f154336c-bfc6-42fd-9301-844991cb41dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:14.233830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f154336c-bfc6-42fd-9301-844991cb41dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:14.234629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f154336c-bfc6-42fd-9301-844991cb41dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:14.235038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f154336c-bfc6-42fd-9301-844991cb41dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:14.272290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f154336c-bfc6-42fd-9301-844991cb41dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052402 Dec 15 16:29:14.272816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 512/1002] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:15.186110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a03daeef-2f83-4715-b3a9-78521dd72f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:15.186865 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a03daeef-2f83-4715-b3a9-78521dd72f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:15.193594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a03daeef-2f83-4715-b3a9-78521dd72f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:15.194031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a03daeef-2f83-4715-b3a9-78521dd72f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:15.194823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a03daeef-2f83-4715-b3a9-78521dd72f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:15.195254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a03daeef-2f83-4715-b3a9-78521dd72f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:15.286989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-63eb3768-db92-49df-b78c-b90fd5ba3c17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:15.288462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-63eb3768-db92-49df-b78c-b90fd5ba3c17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:15.299413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63eb3768-db92-49df-b78c-b90fd5ba3c17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:15.300121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63eb3768-db92-49df-b78c-b90fd5ba3c17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:15.301387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63eb3768-db92-49df-b78c-b90fd5ba3c17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:15.302012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63eb3768-db92-49df-b78c-b90fd5ba3c17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:15.334962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-63eb3768-db92-49df-b78c-b90fd5ba3c17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054587 Dec 15 16:29:15.335551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 513/1003] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:15.346440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a03daeef-2f83-4715-b3a9-78521dd72f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:15.353855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a03daeef-2f83-4715-b3a9-78521dd72f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171801 Dec 15 16:29:15.354421 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 491/1004] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:16.347181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-117abf38-5997-4c83-9112-23829b3e449d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:16.348050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-117abf38-5997-4c83-9112-23829b3e449d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:16.354872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-117abf38-5997-4c83-9112-23829b3e449d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:16.355288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-117abf38-5997-4c83-9112-23829b3e449d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:16.356069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-117abf38-5997-4c83-9112-23829b3e449d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:16.356560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-117abf38-5997-4c83-9112-23829b3e449d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:16.373085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-25bb98bc-f7b7-4ee2-969f-a1ccf819d5c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:16.373774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-25bb98bc-f7b7-4ee2-969f-a1ccf819d5c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:16.381472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25bb98bc-f7b7-4ee2-969f-a1ccf819d5c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:16.381836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25bb98bc-f7b7-4ee2-969f-a1ccf819d5c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:16.382633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25bb98bc-f7b7-4ee2-969f-a1ccf819d5c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:16.383068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25bb98bc-f7b7-4ee2-969f-a1ccf819d5c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:16.388038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-117abf38-5997-4c83-9112-23829b3e449d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044894 Dec 15 16:29:16.389238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 514/1005] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:16 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:16.532742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-25bb98bc-f7b7-4ee2-969f-a1ccf819d5c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:16.541270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-25bb98bc-f7b7-4ee2-969f-a1ccf819d5c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172659 Dec 15 16:29:16.541839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 492/1006] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:16 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:17.399932 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2b53be36-50f6-4409-a499-e8b3e46b3d8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:17.400782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2b53be36-50f6-4409-a499-e8b3e46b3d8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:17.407700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b53be36-50f6-4409-a499-e8b3e46b3d8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:17.408147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b53be36-50f6-4409-a499-e8b3e46b3d8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:17.409008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b53be36-50f6-4409-a499-e8b3e46b3d8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:17.409439 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b53be36-50f6-4409-a499-e8b3e46b3d8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:17.441466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2b53be36-50f6-4409-a499-e8b3e46b3d8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045372 Dec 15 16:29:17.442063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 515/1007] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:17.559734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c86a9f7d-f833-4d32-8f09-2ce182ee69d9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:17.560356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c86a9f7d-f833-4d32-8f09-2ce182ee69d9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:17.567856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c86a9f7d-f833-4d32-8f09-2ce182ee69d9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:17.568283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c86a9f7d-f833-4d32-8f09-2ce182ee69d9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:17.569145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c86a9f7d-f833-4d32-8f09-2ce182ee69d9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:17.569580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c86a9f7d-f833-4d32-8f09-2ce182ee69d9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:17.726226 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c86a9f7d-f833-4d32-8f09-2ce182ee69d9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:17.734060 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c86a9f7d-f833-4d32-8f09-2ce182ee69d9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.178185 Dec 15 16:29:17.734732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 493/1008] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:17 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:18.455184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-35316480-98ac-4ad6-b8c7-35f34ac537c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:18.456792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-35316480-98ac-4ad6-b8c7-35f34ac537c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:18.464890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35316480-98ac-4ad6-b8c7-35f34ac537c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:18.465317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35316480-98ac-4ad6-b8c7-35f34ac537c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:18.466101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35316480-98ac-4ad6-b8c7-35f34ac537c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:18.466528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35316480-98ac-4ad6-b8c7-35f34ac537c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:18.498692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-35316480-98ac-4ad6-b8c7-35f34ac537c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048149 Dec 15 16:29:18.499250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 516/1009] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:18.755063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ed44ad6f-da7f-4454-ab43-1c587e22e9e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:18.755724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ed44ad6f-da7f-4454-ab43-1c587e22e9e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:18.762895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed44ad6f-da7f-4454-ab43-1c587e22e9e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:18.763341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed44ad6f-da7f-4454-ab43-1c587e22e9e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:18.764156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed44ad6f-da7f-4454-ab43-1c587e22e9e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:18.764626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed44ad6f-da7f-4454-ab43-1c587e22e9e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:18.911512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ed44ad6f-da7f-4454-ab43-1c587e22e9e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:18.923890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ed44ad6f-da7f-4454-ab43-1c587e22e9e9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174409 Dec 15 16:29:18.925362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 494/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:19.511045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b07f73fa-1773-4c81-9e0c-dfc5baa12e0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:19.511861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b07f73fa-1773-4c81-9e0c-dfc5baa12e0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:19.519190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b07f73fa-1773-4c81-9e0c-dfc5baa12e0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:19.519621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b07f73fa-1773-4c81-9e0c-dfc5baa12e0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:19.520452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b07f73fa-1773-4c81-9e0c-dfc5baa12e0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:19.520900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b07f73fa-1773-4c81-9e0c-dfc5baa12e0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:19.554475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b07f73fa-1773-4c81-9e0c-dfc5baa12e0b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047403 Dec 15 16:29:19.555087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 517/1011] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:19.947248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e48ebcee-fedc-424c-9890-c9c1a640f242 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:19.947872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e48ebcee-fedc-424c-9890-c9c1a640f242 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:19.954790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e48ebcee-fedc-424c-9890-c9c1a640f242 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:19.955227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e48ebcee-fedc-424c-9890-c9c1a640f242 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:19.956032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e48ebcee-fedc-424c-9890-c9c1a640f242 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:19.956458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e48ebcee-fedc-424c-9890-c9c1a640f242 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:20.104087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e48ebcee-fedc-424c-9890-c9c1a640f242 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:20.115755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e48ebcee-fedc-424c-9890-c9c1a640f242 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172168 Dec 15 16:29:20.116334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 495/1012] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:20.566559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-30f9c7d7-565f-4694-815b-1a7abfc8f963 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:20.567763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-30f9c7d7-565f-4694-815b-1a7abfc8f963 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:20.574549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30f9c7d7-565f-4694-815b-1a7abfc8f963 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:20.574979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30f9c7d7-565f-4694-815b-1a7abfc8f963 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:20.575778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30f9c7d7-565f-4694-815b-1a7abfc8f963 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:20.576212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30f9c7d7-565f-4694-815b-1a7abfc8f963 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:20.619200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-30f9c7d7-565f-4694-815b-1a7abfc8f963 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056443 Dec 15 16:29:20.619765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 518/1013] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:21.135425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ca55fbb1-643a-44c5-b9b1-113a6dc9110a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:21.136033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ca55fbb1-643a-44c5-b9b1-113a6dc9110a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:21.142943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ca55fbb1-643a-44c5-b9b1-113a6dc9110a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:21.143483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ca55fbb1-643a-44c5-b9b1-113a6dc9110a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:21.144256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ca55fbb1-643a-44c5-b9b1-113a6dc9110a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:21.145172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ca55fbb1-643a-44c5-b9b1-113a6dc9110a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:21.292289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ca55fbb1-643a-44c5-b9b1-113a6dc9110a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:21.304892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ca55fbb1-643a-44c5-b9b1-113a6dc9110a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172975 Dec 15 16:29:21.305520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 496/1014] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:21.635105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7d6f27ab-8e1d-45dd-923a-cae7c1b30e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:21.636105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7d6f27ab-8e1d-45dd-923a-cae7c1b30e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:21.643452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d6f27ab-8e1d-45dd-923a-cae7c1b30e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:21.643922 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d6f27ab-8e1d-45dd-923a-cae7c1b30e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:21.644763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d6f27ab-8e1d-45dd-923a-cae7c1b30e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:21.645365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d6f27ab-8e1d-45dd-923a-cae7c1b30e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:21.681253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7d6f27ab-8e1d-45dd-923a-cae7c1b30e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050942 Dec 15 16:29:21.681850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 519/1015] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:22.326007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-68f8c54a-366b-4aa3-9327-cf4c94ecb8e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:22.326647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-68f8c54a-366b-4aa3-9327-cf4c94ecb8e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:22.333736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68f8c54a-366b-4aa3-9327-cf4c94ecb8e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:22.334179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68f8c54a-366b-4aa3-9327-cf4c94ecb8e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:22.334993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68f8c54a-366b-4aa3-9327-cf4c94ecb8e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:22.335430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68f8c54a-366b-4aa3-9327-cf4c94ecb8e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:22.493083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-68f8c54a-366b-4aa3-9327-cf4c94ecb8e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:22.503493 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-68f8c54a-366b-4aa3-9327-cf4c94ecb8e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.182068 Dec 15 16:29:22.504085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 497/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:22 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:22.696772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8042468f-652f-4380-81dd-b50b695f199b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:22.697614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8042468f-652f-4380-81dd-b50b695f199b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:22.705158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8042468f-652f-4380-81dd-b50b695f199b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:22.705604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8042468f-652f-4380-81dd-b50b695f199b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:22.706402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8042468f-652f-4380-81dd-b50b695f199b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:22.706833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8042468f-652f-4380-81dd-b50b695f199b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:22.742283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8042468f-652f-4380-81dd-b50b695f199b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051866 Dec 15 16:29:22.743105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 520/1017] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:23.521935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-052be946-0728-4c00-9693-8e89dc07b4e7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:23.522518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-052be946-0728-4c00-9693-8e89dc07b4e7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:23.529099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-052be946-0728-4c00-9693-8e89dc07b4e7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:23.529537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-052be946-0728-4c00-9693-8e89dc07b4e7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:23.530315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-052be946-0728-4c00-9693-8e89dc07b4e7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:23.530743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-052be946-0728-4c00-9693-8e89dc07b4e7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:23.688855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-052be946-0728-4c00-9693-8e89dc07b4e7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:23.700731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-052be946-0728-4c00-9693-8e89dc07b4e7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.181762 Dec 15 16:29:23.701719 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 498/1018] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:23 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:29:23.756467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-83b10499-f5f5-4c8a-ae5a-69956a7dbdd0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:23.757473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-83b10499-f5f5-4c8a-ae5a-69956a7dbdd0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:23.767375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83b10499-f5f5-4c8a-ae5a-69956a7dbdd0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:23.768057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83b10499-f5f5-4c8a-ae5a-69956a7dbdd0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:23.769259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83b10499-f5f5-4c8a-ae5a-69956a7dbdd0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:23.769894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83b10499-f5f5-4c8a-ae5a-69956a7dbdd0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:23.801433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-83b10499-f5f5-4c8a-ae5a-69956a7dbdd0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050397 Dec 15 16:29:23.801908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 521/1019] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:24.724166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-722a4a1a-2bc4-4137-bb76-4c63e3197c72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:24.725271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-722a4a1a-2bc4-4137-bb76-4c63e3197c72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:24.731980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-722a4a1a-2bc4-4137-bb76-4c63e3197c72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:24.732456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-722a4a1a-2bc4-4137-bb76-4c63e3197c72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:24.733257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-722a4a1a-2bc4-4137-bb76-4c63e3197c72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:24.733700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-722a4a1a-2bc4-4137-bb76-4c63e3197c72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:24.813313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-57b7df21-efc8-4be0-997f-35323b1d560a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:24.814308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-57b7df21-efc8-4be0-997f-35323b1d560a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:24.823124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57b7df21-efc8-4be0-997f-35323b1d560a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:24.823124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57b7df21-efc8-4be0-997f-35323b1d560a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:24.823124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57b7df21-efc8-4be0-997f-35323b1d560a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:24.823124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57b7df21-efc8-4be0-997f-35323b1d560a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:24.855213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-57b7df21-efc8-4be0-997f-35323b1d560a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045561 Dec 15 16:29:24.856359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 522/1020] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:24.894574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-722a4a1a-2bc4-4137-bb76-4c63e3197c72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:24.906151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-722a4a1a-2bc4-4137-bb76-4c63e3197c72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.186518 Dec 15 16:29:24.907055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 499/1021] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:25.869550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c29bf6ae-ff6a-4e02-bc88-353658b2962c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:25.870358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c29bf6ae-ff6a-4e02-bc88-353658b2962c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:25.877603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c29bf6ae-ff6a-4e02-bc88-353658b2962c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:25.878049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c29bf6ae-ff6a-4e02-bc88-353658b2962c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:25.878838 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c29bf6ae-ff6a-4e02-bc88-353658b2962c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:25.879266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c29bf6ae-ff6a-4e02-bc88-353658b2962c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:25.910062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c29bf6ae-ff6a-4e02-bc88-353658b2962c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044525 Dec 15 16:29:25.910615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 523/1022] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:25.924020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3d78c7d5-c642-4dbf-bc1e-237fe3032ba9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:25.924655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3d78c7d5-c642-4dbf-bc1e-237fe3032ba9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:25.931635 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d78c7d5-c642-4dbf-bc1e-237fe3032ba9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:25.932084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d78c7d5-c642-4dbf-bc1e-237fe3032ba9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:25.932896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d78c7d5-c642-4dbf-bc1e-237fe3032ba9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:25.933336 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d78c7d5-c642-4dbf-bc1e-237fe3032ba9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:26.080290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3d78c7d5-c642-4dbf-bc1e-237fe3032ba9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:26.088983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3d78c7d5-c642-4dbf-bc1e-237fe3032ba9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168694 Dec 15 16:29:26.089551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 500/1023] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:26.923561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-abac597d-0260-4a94-8777-8eb131b42679 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:26.924539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-abac597d-0260-4a94-8777-8eb131b42679 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:26.932042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-abac597d-0260-4a94-8777-8eb131b42679 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:26.932529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-abac597d-0260-4a94-8777-8eb131b42679 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:26.933372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-abac597d-0260-4a94-8777-8eb131b42679 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:26.933794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-abac597d-0260-4a94-8777-8eb131b42679 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:26.968157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-abac597d-0260-4a94-8777-8eb131b42679 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048329 Dec 15 16:29:26.968793 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 524/1024] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:27.107368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-92b462f2-6e7d-4fc2-9526-71f0c0f93141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:27.107952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-92b462f2-6e7d-4fc2-9526-71f0c0f93141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:27.114624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b462f2-6e7d-4fc2-9526-71f0c0f93141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:27.115075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b462f2-6e7d-4fc2-9526-71f0c0f93141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:27.115857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b462f2-6e7d-4fc2-9526-71f0c0f93141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:27.116279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92b462f2-6e7d-4fc2-9526-71f0c0f93141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:27.528742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-92b462f2-6e7d-4fc2-9526-71f0c0f93141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:27.536906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-92b462f2-6e7d-4fc2-9526-71f0c0f93141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.433171 Dec 15 16:29:27.537500 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 501/1025] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:27.981220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-14f0f5ca-ef7e-487e-8a92-6783b13574ec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:27.982111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-14f0f5ca-ef7e-487e-8a92-6783b13574ec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:27.988634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14f0f5ca-ef7e-487e-8a92-6783b13574ec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:27.989079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14f0f5ca-ef7e-487e-8a92-6783b13574ec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:27.989849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14f0f5ca-ef7e-487e-8a92-6783b13574ec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:27.990274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14f0f5ca-ef7e-487e-8a92-6783b13574ec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:28.025070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-14f0f5ca-ef7e-487e-8a92-6783b13574ec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047646 Dec 15 16:29:28.025665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 525/1026] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:28.555304 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9856f6c1-6e7b-4fc4-9440-2a9e747b09ad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:28.555958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9856f6c1-6e7b-4fc4-9440-2a9e747b09ad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:28.562710 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9856f6c1-6e7b-4fc4-9440-2a9e747b09ad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:28.563153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9856f6c1-6e7b-4fc4-9440-2a9e747b09ad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:28.563930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9856f6c1-6e7b-4fc4-9440-2a9e747b09ad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:28.564377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9856f6c1-6e7b-4fc4-9440-2a9e747b09ad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:28.717405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9856f6c1-6e7b-4fc4-9440-2a9e747b09ad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:28.725954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9856f6c1-6e7b-4fc4-9440-2a9e747b09ad tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174384 Dec 15 16:29:28.726655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 502/1027] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:29.036907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-07aa2b3c-da2e-43fb-9ae1-85a6fec53f80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:29.037817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-07aa2b3c-da2e-43fb-9ae1-85a6fec53f80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:29.044797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07aa2b3c-da2e-43fb-9ae1-85a6fec53f80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:29.045244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07aa2b3c-da2e-43fb-9ae1-85a6fec53f80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:29.046044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07aa2b3c-da2e-43fb-9ae1-85a6fec53f80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:29.046467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07aa2b3c-da2e-43fb-9ae1-85a6fec53f80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:29.077317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-07aa2b3c-da2e-43fb-9ae1-85a6fec53f80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044130 Dec 15 16:29:29.077869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 526/1028] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:29.748934 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2f399ac0-dd75-4a70-9b5f-c3ad5c6e287e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:29.749544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2f399ac0-dd75-4a70-9b5f-c3ad5c6e287e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:29.755989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f399ac0-dd75-4a70-9b5f-c3ad5c6e287e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:29.756452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f399ac0-dd75-4a70-9b5f-c3ad5c6e287e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:29.757269 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f399ac0-dd75-4a70-9b5f-c3ad5c6e287e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:29.757864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f399ac0-dd75-4a70-9b5f-c3ad5c6e287e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:29.909753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2f399ac0-dd75-4a70-9b5f-c3ad5c6e287e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:29.922360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2f399ac0-dd75-4a70-9b5f-c3ad5c6e287e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.177410 Dec 15 16:29:29.923207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 503/1029] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:30.089723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7eb3d5a5-ec00-4a69-980e-898a90984216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:30.090826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7eb3d5a5-ec00-4a69-980e-898a90984216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:30.098762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7eb3d5a5-ec00-4a69-980e-898a90984216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:30.099125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7eb3d5a5-ec00-4a69-980e-898a90984216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:30.099897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7eb3d5a5-ec00-4a69-980e-898a90984216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:30.100322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7eb3d5a5-ec00-4a69-980e-898a90984216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:30.133069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7eb3d5a5-ec00-4a69-980e-898a90984216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047232 Dec 15 16:29:30.133642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 527/1030] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:30.942438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c555c408-7f69-4822-ac64-376c3b39416b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:30.943106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c555c408-7f69-4822-ac64-376c3b39416b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:30.950350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c555c408-7f69-4822-ac64-376c3b39416b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:30.950827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c555c408-7f69-4822-ac64-376c3b39416b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:30.951716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c555c408-7f69-4822-ac64-376c3b39416b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:30.952461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c555c408-7f69-4822-ac64-376c3b39416b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:31.103465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c555c408-7f69-4822-ac64-376c3b39416b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:31.114829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c555c408-7f69-4822-ac64-376c3b39416b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.175885 Dec 15 16:29:31.115627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 504/1031] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:30 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:31.145003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-048b49b0-8629-40a8-90ec-e3d8a02ee5e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:31.145907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-048b49b0-8629-40a8-90ec-e3d8a02ee5e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:31.152695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-048b49b0-8629-40a8-90ec-e3d8a02ee5e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:31.153144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-048b49b0-8629-40a8-90ec-e3d8a02ee5e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:31.153947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-048b49b0-8629-40a8-90ec-e3d8a02ee5e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:31.154379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-048b49b0-8629-40a8-90ec-e3d8a02ee5e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:31.184703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-048b49b0-8629-40a8-90ec-e3d8a02ee5e2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043492 Dec 15 16:29:31.185322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 528/1032] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:29:32.133692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-346e4318-f3da-4d85-8b4f-4fe878b15c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:32.134325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-346e4318-f3da-4d85-8b4f-4fe878b15c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:32.141061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-346e4318-f3da-4d85-8b4f-4fe878b15c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:32.141501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-346e4318-f3da-4d85-8b4f-4fe878b15c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:32.142278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-346e4318-f3da-4d85-8b4f-4fe878b15c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:32.142704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-346e4318-f3da-4d85-8b4f-4fe878b15c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:32.197493 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-93915f7d-82e8-4988-8d87-b089af48e03c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:32.198453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-93915f7d-82e8-4988-8d87-b089af48e03c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:32.205167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93915f7d-82e8-4988-8d87-b089af48e03c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:32.205611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93915f7d-82e8-4988-8d87-b089af48e03c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:32.206395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93915f7d-82e8-4988-8d87-b089af48e03c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:32.206819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93915f7d-82e8-4988-8d87-b089af48e03c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:32.237894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-93915f7d-82e8-4988-8d87-b089af48e03c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044906 Dec 15 16:29:32.239203 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 529/1033] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:32.294134 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-346e4318-f3da-4d85-8b4f-4fe878b15c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:32.302056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-346e4318-f3da-4d85-8b4f-4fe878b15c66 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172148 Dec 15 16:29:32.302909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 505/1034] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:33.250701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eaa14aa3-139d-4422-8c88-c587eae7d5fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:33.251660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eaa14aa3-139d-4422-8c88-c587eae7d5fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:33.259065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eaa14aa3-139d-4422-8c88-c587eae7d5fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:33.259518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eaa14aa3-139d-4422-8c88-c587eae7d5fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:33.260330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eaa14aa3-139d-4422-8c88-c587eae7d5fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:33.260912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eaa14aa3-139d-4422-8c88-c587eae7d5fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:33.294217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eaa14aa3-139d-4422-8c88-c587eae7d5fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047892 Dec 15 16:29:33.294810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 530/1035] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:33.325330 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1ea968ae-c3e2-4fb7-b505-21574d657921 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:33.326055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1ea968ae-c3e2-4fb7-b505-21574d657921 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:33.332589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ea968ae-c3e2-4fb7-b505-21574d657921 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:33.333036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ea968ae-c3e2-4fb7-b505-21574d657921 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:33.333829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ea968ae-c3e2-4fb7-b505-21574d657921 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:33.334262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ea968ae-c3e2-4fb7-b505-21574d657921 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:33.644831 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1ea968ae-c3e2-4fb7-b505-21574d657921 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:33.653121 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1ea968ae-c3e2-4fb7-b505-21574d657921 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.332679 Dec 15 16:29:33.653761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 506/1036] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:34.307785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3a0b78b2-839b-4392-9b3c-b4510fcd9802 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:34.309516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3a0b78b2-839b-4392-9b3c-b4510fcd9802 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:34.321001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a0b78b2-839b-4392-9b3c-b4510fcd9802 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:34.321766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a0b78b2-839b-4392-9b3c-b4510fcd9802 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:34.323207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a0b78b2-839b-4392-9b3c-b4510fcd9802 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:34.323744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a0b78b2-839b-4392-9b3c-b4510fcd9802 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:34.359787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3a0b78b2-839b-4392-9b3c-b4510fcd9802 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057243 Dec 15 16:29:34.360325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 531/1037] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:34.671678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a6e3c350-b622-4af7-865a-0b187ecf1243 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:34.672341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a6e3c350-b622-4af7-865a-0b187ecf1243 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:34.684104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6e3c350-b622-4af7-865a-0b187ecf1243 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:34.684892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6e3c350-b622-4af7-865a-0b187ecf1243 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:34.686286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6e3c350-b622-4af7-865a-0b187ecf1243 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:34.686939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6e3c350-b622-4af7-865a-0b187ecf1243 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:34.847918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a6e3c350-b622-4af7-865a-0b187ecf1243 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:34.856978 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a6e3c350-b622-4af7-865a-0b187ecf1243 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.189231 Dec 15 16:29:34.857635 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 507/1038] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:34 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:35.371681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dccf273a-71d0-4582-9d59-1f7849408993 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:35.372971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dccf273a-71d0-4582-9d59-1f7849408993 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:35.379392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dccf273a-71d0-4582-9d59-1f7849408993 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:35.379832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dccf273a-71d0-4582-9d59-1f7849408993 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:35.380639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dccf273a-71d0-4582-9d59-1f7849408993 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:35.381065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dccf273a-71d0-4582-9d59-1f7849408993 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:35.419312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dccf273a-71d0-4582-9d59-1f7849408993 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051364 Dec 15 16:29:35.419940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 532/1039] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:35.879246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2a4e4a20-8c3e-483e-a754-9598c48055f9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:35.880040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2a4e4a20-8c3e-483e-a754-9598c48055f9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:35.890294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a4e4a20-8c3e-483e-a754-9598c48055f9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:35.890950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a4e4a20-8c3e-483e-a754-9598c48055f9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:35.892207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a4e4a20-8c3e-483e-a754-9598c48055f9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:35.892944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a4e4a20-8c3e-483e-a754-9598c48055f9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:36.045672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2a4e4a20-8c3e-483e-a754-9598c48055f9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:36.053481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2a4e4a20-8c3e-483e-a754-9598c48055f9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.180083 Dec 15 16:29:36.054047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 508/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:36.433404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8ca7c0fc-db80-4f79-a935-c8e0fba04a7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:36.434300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8ca7c0fc-db80-4f79-a935-c8e0fba04a7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:36.441079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ca7c0fc-db80-4f79-a935-c8e0fba04a7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:36.441526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ca7c0fc-db80-4f79-a935-c8e0fba04a7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:36.442311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ca7c0fc-db80-4f79-a935-c8e0fba04a7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:36.442740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ca7c0fc-db80-4f79-a935-c8e0fba04a7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:36.473876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8ca7c0fc-db80-4f79-a935-c8e0fba04a7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045308 Dec 15 16:29:36.474442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 533/1041] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:37.071579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-de172bfa-1914-484d-a929-c2ff82455bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:37.072220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-de172bfa-1914-484d-a929-c2ff82455bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:37.079002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de172bfa-1914-484d-a929-c2ff82455bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:37.079501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de172bfa-1914-484d-a929-c2ff82455bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:37.080310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de172bfa-1914-484d-a929-c2ff82455bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:37.080782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de172bfa-1914-484d-a929-c2ff82455bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:37.232067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-de172bfa-1914-484d-a929-c2ff82455bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:37.240110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-de172bfa-1914-484d-a929-c2ff82455bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172829 Dec 15 16:29:37.240723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 509/1042] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:37 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:37.488951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-04acf12d-bbaa-4d27-b340-4c88bf950210 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:37.489763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-04acf12d-bbaa-4d27-b340-4c88bf950210 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:37.498060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-04acf12d-bbaa-4d27-b340-4c88bf950210 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:37.498725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-04acf12d-bbaa-4d27-b340-4c88bf950210 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:37.499958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-04acf12d-bbaa-4d27-b340-4c88bf950210 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:37.500722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-04acf12d-bbaa-4d27-b340-4c88bf950210 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:37.534947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-04acf12d-bbaa-4d27-b340-4c88bf950210 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050619 Dec 15 16:29:37.535498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 534/1043] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:38.258866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a38c69c4-6bf4-44f7-ab16-b56af9c3a892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:38.260156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a38c69c4-6bf4-44f7-ab16-b56af9c3a892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:38.267017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a38c69c4-6bf4-44f7-ab16-b56af9c3a892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:38.267456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a38c69c4-6bf4-44f7-ab16-b56af9c3a892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:38.268259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a38c69c4-6bf4-44f7-ab16-b56af9c3a892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:38.268743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a38c69c4-6bf4-44f7-ab16-b56af9c3a892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:38.419055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a38c69c4-6bf4-44f7-ab16-b56af9c3a892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:38.426859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a38c69c4-6bf4-44f7-ab16-b56af9c3a892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171866 Dec 15 16:29:38.427431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 510/1044] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:38.548164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fc6c8053-e1c7-4133-85fa-4d20c80cb410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:38.549093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fc6c8053-e1c7-4133-85fa-4d20c80cb410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:38.557372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc6c8053-e1c7-4133-85fa-4d20c80cb410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:38.557837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc6c8053-e1c7-4133-85fa-4d20c80cb410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:38.558627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc6c8053-e1c7-4133-85fa-4d20c80cb410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:38.559052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc6c8053-e1c7-4133-85fa-4d20c80cb410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:38.589685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fc6c8053-e1c7-4133-85fa-4d20c80cb410 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046542 Dec 15 16:29:38.590268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 535/1045] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:39.446371 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f0db185c-f2c8-495d-9614-6ba690a8d7bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:39.447068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f0db185c-f2c8-495d-9614-6ba690a8d7bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:39.456416 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0db185c-f2c8-495d-9614-6ba690a8d7bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:39.457096 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0db185c-f2c8-495d-9614-6ba690a8d7bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:39.458270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0db185c-f2c8-495d-9614-6ba690a8d7bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:39.458817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0db185c-f2c8-495d-9614-6ba690a8d7bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:39.602672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-74715dd1-7b72-48a7-a8a6-7aa95056178b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:39.603552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-74715dd1-7b72-48a7-a8a6-7aa95056178b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:39.610506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74715dd1-7b72-48a7-a8a6-7aa95056178b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:39.610950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74715dd1-7b72-48a7-a8a6-7aa95056178b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:39.611744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74715dd1-7b72-48a7-a8a6-7aa95056178b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:39.612176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74715dd1-7b72-48a7-a8a6-7aa95056178b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:39.612280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f0db185c-f2c8-495d-9614-6ba690a8d7bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:39.620122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f0db185c-f2c8-495d-9614-6ba690a8d7bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.179663 Dec 15 16:29:39.620786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 511/1046] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:39.643627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-74715dd1-7b72-48a7-a8a6-7aa95056178b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044868 Dec 15 16:29:39.644196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 536/1047] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:40.639215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-83184ac9-fec2-43f7-aad0-4302222c69ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:40.639942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-83184ac9-fec2-43f7-aad0-4302222c69ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:40.647120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83184ac9-fec2-43f7-aad0-4302222c69ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:40.647616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83184ac9-fec2-43f7-aad0-4302222c69ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:40.648541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83184ac9-fec2-43f7-aad0-4302222c69ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:40.648974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83184ac9-fec2-43f7-aad0-4302222c69ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:40.656628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9aab855c-1ed4-409d-92d1-43ecc5842bda tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:40.657638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9aab855c-1ed4-409d-92d1-43ecc5842bda tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:40.664828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9aab855c-1ed4-409d-92d1-43ecc5842bda tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:40.665260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9aab855c-1ed4-409d-92d1-43ecc5842bda tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:40.666056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9aab855c-1ed4-409d-92d1-43ecc5842bda tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:40.666613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9aab855c-1ed4-409d-92d1-43ecc5842bda tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:40.698635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9aab855c-1ed4-409d-92d1-43ecc5842bda tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045735 Dec 15 16:29:40.699229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 537/1048] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:29:40.797746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-83184ac9-fec2-43f7-aad0-4302222c69ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:40.807528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-83184ac9-fec2-43f7-aad0-4302222c69ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172633 Dec 15 16:29:40.808084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 512/1049] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:40 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:41.710439 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-67e6e51b-2f60-45c3-95ef-b6651f525563 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:41.711335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-67e6e51b-2f60-45c3-95ef-b6651f525563 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:41.719006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-67e6e51b-2f60-45c3-95ef-b6651f525563 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:41.719424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-67e6e51b-2f60-45c3-95ef-b6651f525563 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:41.720216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-67e6e51b-2f60-45c3-95ef-b6651f525563 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:41.720704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-67e6e51b-2f60-45c3-95ef-b6651f525563 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:41.753146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-67e6e51b-2f60-45c3-95ef-b6651f525563 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046420 Dec 15 16:29:41.753731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 538/1050] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:41.829517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-448befb1-c2bf-4d89-ae36-835310f2f10e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:41.830144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-448befb1-c2bf-4d89-ae36-835310f2f10e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:41.837004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-448befb1-c2bf-4d89-ae36-835310f2f10e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:41.837449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-448befb1-c2bf-4d89-ae36-835310f2f10e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:41.838410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-448befb1-c2bf-4d89-ae36-835310f2f10e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:41.838924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-448befb1-c2bf-4d89-ae36-835310f2f10e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:41.986201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-448befb1-c2bf-4d89-ae36-835310f2f10e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:41.994574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-448befb1-c2bf-4d89-ae36-835310f2f10e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169363 Dec 15 16:29:41.995349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 513/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:41 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:42.764795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3e898468-db1c-4920-8af5-47e4fb4c7eb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:42.765732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3e898468-db1c-4920-8af5-47e4fb4c7eb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:42.772308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e898468-db1c-4920-8af5-47e4fb4c7eb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:42.772818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e898468-db1c-4920-8af5-47e4fb4c7eb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:42.773623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e898468-db1c-4920-8af5-47e4fb4c7eb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:42.774058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e898468-db1c-4920-8af5-47e4fb4c7eb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:42.805215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3e898468-db1c-4920-8af5-47e4fb4c7eb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044502 Dec 15 16:29:42.805784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 539/1052] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:43.014455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-abc0d5ac-5187-4d4c-8ae2-0c2e3f46f9e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:43.015139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-abc0d5ac-5187-4d4c-8ae2-0c2e3f46f9e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:43.022035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:29:43.022298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:29:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:29:43.023609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abc0d5ac-5187-4d4c-8ae2-0c2e3f46f9e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:43.024107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abc0d5ac-5187-4d4c-8ae2-0c2e3f46f9e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:43.024899 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abc0d5ac-5187-4d4c-8ae2-0c2e3f46f9e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:43.025324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abc0d5ac-5187-4d4c-8ae2-0c2e3f46f9e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:43.162803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-abc0d5ac-5187-4d4c-8ae2-0c2e3f46f9e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:43.170651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-abc0d5ac-5187-4d4c-8ae2-0c2e3f46f9e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.161527 Dec 15 16:29:43.171221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 514/1053] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:43 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:29:43.818219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8421fd7c-5cee-4c38-b2ac-9b5a48e42978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:43.819163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8421fd7c-5cee-4c38-b2ac-9b5a48e42978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:43.826859 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8421fd7c-5cee-4c38-b2ac-9b5a48e42978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:43.827336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8421fd7c-5cee-4c38-b2ac-9b5a48e42978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:43.828241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8421fd7c-5cee-4c38-b2ac-9b5a48e42978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:43.828703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8421fd7c-5cee-4c38-b2ac-9b5a48e42978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:43.858980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8421fd7c-5cee-4c38-b2ac-9b5a48e42978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045276 Dec 15 16:29:43.859440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 540/1054] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:44.189953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fdf7e742-3b96-46bb-b5e2-732c6bbadc75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:44.190552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fdf7e742-3b96-46bb-b5e2-732c6bbadc75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:44.197217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdf7e742-3b96-46bb-b5e2-732c6bbadc75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:44.197663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdf7e742-3b96-46bb-b5e2-732c6bbadc75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:44.198470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdf7e742-3b96-46bb-b5e2-732c6bbadc75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:44.198910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdf7e742-3b96-46bb-b5e2-732c6bbadc75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:44.374340 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fdf7e742-3b96-46bb-b5e2-732c6bbadc75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:44.382267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fdf7e742-3b96-46bb-b5e2-732c6bbadc75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.196856 Dec 15 16:29:44.382767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 515/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:44.870979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e7b56459-612c-46bf-ab27-9b7906786db4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:44.871883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e7b56459-612c-46bf-ab27-9b7906786db4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:44.879419 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7b56459-612c-46bf-ab27-9b7906786db4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:44.879894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7b56459-612c-46bf-ab27-9b7906786db4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:44.880746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7b56459-612c-46bf-ab27-9b7906786db4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:44.881182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7b56459-612c-46bf-ab27-9b7906786db4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:44.913798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e7b56459-612c-46bf-ab27-9b7906786db4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046578 Dec 15 16:29:44.914353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 541/1056] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:45.399674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-708f6cc6-b3d1-4908-bb11-f8f763c4faf4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:45.400230 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-708f6cc6-b3d1-4908-bb11-f8f763c4faf4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:45.407655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-708f6cc6-b3d1-4908-bb11-f8f763c4faf4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:45.408102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-708f6cc6-b3d1-4908-bb11-f8f763c4faf4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:45.408962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-708f6cc6-b3d1-4908-bb11-f8f763c4faf4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:45.409389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-708f6cc6-b3d1-4908-bb11-f8f763c4faf4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:45.564393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-708f6cc6-b3d1-4908-bb11-f8f763c4faf4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:45.573579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-708f6cc6-b3d1-4908-bb11-f8f763c4faf4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.177761 Dec 15 16:29:45.574147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 516/1057] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:45.926385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b9341308-e72c-4eb5-9105-7cc25a4cb198 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:45.927902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b9341308-e72c-4eb5-9105-7cc25a4cb198 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:45.942300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9341308-e72c-4eb5-9105-7cc25a4cb198 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:45.942300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9341308-e72c-4eb5-9105-7cc25a4cb198 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:45.942300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9341308-e72c-4eb5-9105-7cc25a4cb198 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:45.942300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9341308-e72c-4eb5-9105-7cc25a4cb198 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:45.975474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b9341308-e72c-4eb5-9105-7cc25a4cb198 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053065 Dec 15 16:29:45.976048 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 542/1058] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:46.592058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0289ffab-f1d5-4c23-be40-2761e2ba8f7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:46.592728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0289ffab-f1d5-4c23-be40-2761e2ba8f7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:46.599782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0289ffab-f1d5-4c23-be40-2761e2ba8f7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:46.600249 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0289ffab-f1d5-4c23-be40-2761e2ba8f7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:46.601247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0289ffab-f1d5-4c23-be40-2761e2ba8f7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:46.601761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0289ffab-f1d5-4c23-be40-2761e2ba8f7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:46.747715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0289ffab-f1d5-4c23-be40-2761e2ba8f7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:46.758525 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0289ffab-f1d5-4c23-be40-2761e2ba8f7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170133 Dec 15 16:29:46.759135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 517/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:46 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:46.987345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4866dcd8-1dd5-446f-9093-69323a77e058 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:46.988741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4866dcd8-1dd5-446f-9093-69323a77e058 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:46.998853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4866dcd8-1dd5-446f-9093-69323a77e058 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:46.999291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4866dcd8-1dd5-446f-9093-69323a77e058 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:47.000218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4866dcd8-1dd5-446f-9093-69323a77e058 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:47.000683 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4866dcd8-1dd5-446f-9093-69323a77e058 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:47.035565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4866dcd8-1dd5-446f-9093-69323a77e058 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052510 Dec 15 16:29:47.036152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 543/1060] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:47.775955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-97e6cefc-2bec-49da-abbf-0bb626e04e7c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:47.776646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-97e6cefc-2bec-49da-abbf-0bb626e04e7c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:47.783652 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97e6cefc-2bec-49da-abbf-0bb626e04e7c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:47.784071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97e6cefc-2bec-49da-abbf-0bb626e04e7c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:47.784937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97e6cefc-2bec-49da-abbf-0bb626e04e7c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:47.785368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97e6cefc-2bec-49da-abbf-0bb626e04e7c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:47.933402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-97e6cefc-2bec-49da-abbf-0bb626e04e7c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:47.941799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-97e6cefc-2bec-49da-abbf-0bb626e04e7c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169615 Dec 15 16:29:47.942378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 518/1061] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:48.047895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-626930b1-736c-4fe9-8c40-155de8c32ad1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:48.048999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-626930b1-736c-4fe9-8c40-155de8c32ad1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:48.056095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-626930b1-736c-4fe9-8c40-155de8c32ad1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:48.056559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-626930b1-736c-4fe9-8c40-155de8c32ad1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:48.057390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-626930b1-736c-4fe9-8c40-155de8c32ad1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:48.057827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-626930b1-736c-4fe9-8c40-155de8c32ad1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:48.088579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-626930b1-736c-4fe9-8c40-155de8c32ad1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044846 Dec 15 16:29:48.089143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 544/1062] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:48 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:48.960999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f4883ecb-0b7e-45e5-ac52-26dcbacb7109 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:48.961903 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f4883ecb-0b7e-45e5-ac52-26dcbacb7109 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:48.968330 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f4883ecb-0b7e-45e5-ac52-26dcbacb7109 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:48.968870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f4883ecb-0b7e-45e5-ac52-26dcbacb7109 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:48.969658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f4883ecb-0b7e-45e5-ac52-26dcbacb7109 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:48.970086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f4883ecb-0b7e-45e5-ac52-26dcbacb7109 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:49.100491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-73d4cd24-39bf-4a15-bf37-97764062acb7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:49.101417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-73d4cd24-39bf-4a15-bf37-97764062acb7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:49.106513 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f4883ecb-0b7e-45e5-ac52-26dcbacb7109 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:49.107848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73d4cd24-39bf-4a15-bf37-97764062acb7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:49.108296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73d4cd24-39bf-4a15-bf37-97764062acb7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:49.109093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73d4cd24-39bf-4a15-bf37-97764062acb7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:49.109715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73d4cd24-39bf-4a15-bf37-97764062acb7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:49.114953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f4883ecb-0b7e-45e5-ac52-26dcbacb7109 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.158390 Dec 15 16:29:49.115610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 519/1063] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:49.139862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-73d4cd24-39bf-4a15-bf37-97764062acb7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043095 Dec 15 16:29:49.140389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 545/1064] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:29:50.136101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-97d8aad1-9883-4e8e-93f2-93a3e731ac9e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:50.136768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-97d8aad1-9883-4e8e-93f2-93a3e731ac9e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:50.145404 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97d8aad1-9883-4e8e-93f2-93a3e731ac9e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:50.145830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97d8aad1-9883-4e8e-93f2-93a3e731ac9e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:50.146609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97d8aad1-9883-4e8e-93f2-93a3e731ac9e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:50.147048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97d8aad1-9883-4e8e-93f2-93a3e731ac9e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:50.151217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b209e093-490d-4461-a271-957a8b210e24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:50.152119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b209e093-490d-4461-a271-957a8b210e24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:50.158721 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b209e093-490d-4461-a271-957a8b210e24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:50.159172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b209e093-490d-4461-a271-957a8b210e24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:50.160154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b209e093-490d-4461-a271-957a8b210e24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:50.160685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b209e093-490d-4461-a271-957a8b210e24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:50.191223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b209e093-490d-4461-a271-957a8b210e24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043730 Dec 15 16:29:50.191935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 546/1065] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:50.288193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-97d8aad1-9883-4e8e-93f2-93a3e731ac9e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:50.300801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-97d8aad1-9883-4e8e-93f2-93a3e731ac9e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170065 Dec 15 16:29:50.301390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 520/1066] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:50 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:51.203440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8b01b459-917c-4ee5-af12-3bcca8dd0981 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:51.204416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8b01b459-917c-4ee5-af12-3bcca8dd0981 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:51.211136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b01b459-917c-4ee5-af12-3bcca8dd0981 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:51.211569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b01b459-917c-4ee5-af12-3bcca8dd0981 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:51.212394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b01b459-917c-4ee5-af12-3bcca8dd0981 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:51.212936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b01b459-917c-4ee5-af12-3bcca8dd0981 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:51.242918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8b01b459-917c-4ee5-af12-3bcca8dd0981 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043229 Dec 15 16:29:51.243464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 547/1067] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:51.318298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-56facf65-ce85-472b-ac1e-a55d6c6084c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:51.318966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-56facf65-ce85-472b-ac1e-a55d6c6084c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:51.325852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56facf65-ce85-472b-ac1e-a55d6c6084c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:51.326307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56facf65-ce85-472b-ac1e-a55d6c6084c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:51.327124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56facf65-ce85-472b-ac1e-a55d6c6084c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:51.327559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56facf65-ce85-472b-ac1e-a55d6c6084c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:51.471130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-56facf65-ce85-472b-ac1e-a55d6c6084c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:51.479231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-56facf65-ce85-472b-ac1e-a55d6c6084c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165024 Dec 15 16:29:51.479803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 521/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:52.256150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7450d309-5db8-4517-a700-3799388b3a37 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:52.257021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7450d309-5db8-4517-a700-3799388b3a37 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:52.263745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7450d309-5db8-4517-a700-3799388b3a37 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:52.264194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7450d309-5db8-4517-a700-3799388b3a37 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:52.265029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7450d309-5db8-4517-a700-3799388b3a37 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:52.265465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7450d309-5db8-4517-a700-3799388b3a37 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:52.296472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7450d309-5db8-4517-a700-3799388b3a37 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044506 Dec 15 16:29:52.297089 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 548/1069] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:52.500053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-49af47d0-8fac-4d02-b9ff-1b58426a25ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:52.500901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-49af47d0-8fac-4d02-b9ff-1b58426a25ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:52.510564 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49af47d0-8fac-4d02-b9ff-1b58426a25ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:52.511049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49af47d0-8fac-4d02-b9ff-1b58426a25ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:52.512267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49af47d0-8fac-4d02-b9ff-1b58426a25ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:52.512876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49af47d0-8fac-4d02-b9ff-1b58426a25ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:52.656147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-49af47d0-8fac-4d02-b9ff-1b58426a25ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:52.665372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-49af47d0-8fac-4d02-b9ff-1b58426a25ff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171362 Dec 15 16:29:52.665914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 522/1070] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:53.309538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-39be8d7e-d8c4-425f-ba53-1dc1388d7737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:53.310439 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-39be8d7e-d8c4-425f-ba53-1dc1388d7737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:53.317006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39be8d7e-d8c4-425f-ba53-1dc1388d7737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:53.317474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39be8d7e-d8c4-425f-ba53-1dc1388d7737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:53.318258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39be8d7e-d8c4-425f-ba53-1dc1388d7737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:53.318693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39be8d7e-d8c4-425f-ba53-1dc1388d7737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:53.350704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-39be8d7e-d8c4-425f-ba53-1dc1388d7737 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045440 Dec 15 16:29:53.351297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 549/1071] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:53.683402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f8c82466-bcf1-4014-8b8c-c96a70d08cdb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:53.684498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f8c82466-bcf1-4014-8b8c-c96a70d08cdb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:53.691124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f8c82466-bcf1-4014-8b8c-c96a70d08cdb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:53.691571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f8c82466-bcf1-4014-8b8c-c96a70d08cdb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:53.692374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f8c82466-bcf1-4014-8b8c-c96a70d08cdb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:53.692841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f8c82466-bcf1-4014-8b8c-c96a70d08cdb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:53.855202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f8c82466-bcf1-4014-8b8c-c96a70d08cdb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:53.864665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f8c82466-bcf1-4014-8b8c-c96a70d08cdb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.184818 Dec 15 16:29:53.865225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 523/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:53 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:54.365227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cbbde5f0-1b24-4b7a-bd7a-cbe59d3ef51f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:54.366151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cbbde5f0-1b24-4b7a-bd7a-cbe59d3ef51f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:54.372979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbbde5f0-1b24-4b7a-bd7a-cbe59d3ef51f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:54.373790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbbde5f0-1b24-4b7a-bd7a-cbe59d3ef51f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:54.374579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbbde5f0-1b24-4b7a-bd7a-cbe59d3ef51f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:54.375000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbbde5f0-1b24-4b7a-bd7a-cbe59d3ef51f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:54.406096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cbbde5f0-1b24-4b7a-bd7a-cbe59d3ef51f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045157 Dec 15 16:29:54.406559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 550/1073] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:54.882681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-65c6feb7-0271-4b52-a6f0-6d67a14df3ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:54.883319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-65c6feb7-0271-4b52-a6f0-6d67a14df3ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:54.890037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65c6feb7-0271-4b52-a6f0-6d67a14df3ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:54.890483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65c6feb7-0271-4b52-a6f0-6d67a14df3ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:54.891271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65c6feb7-0271-4b52-a6f0-6d67a14df3ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:54.891691 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65c6feb7-0271-4b52-a6f0-6d67a14df3ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:55.037483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-65c6feb7-0271-4b52-a6f0-6d67a14df3ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:55.048402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-65c6feb7-0271-4b52-a6f0-6d67a14df3ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169221 Dec 15 16:29:55.049252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 524/1074] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:54 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:55.422331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c85c6b6d-26bd-4e99-b3b1-690302576f8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:55.423431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c85c6b6d-26bd-4e99-b3b1-690302576f8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:55.431146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c85c6b6d-26bd-4e99-b3b1-690302576f8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:55.431713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c85c6b6d-26bd-4e99-b3b1-690302576f8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:55.432406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c85c6b6d-26bd-4e99-b3b1-690302576f8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:55.432877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c85c6b6d-26bd-4e99-b3b1-690302576f8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:55.463622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c85c6b6d-26bd-4e99-b3b1-690302576f8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047271 Dec 15 16:29:55.464176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 551/1075] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:56.075708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-19e694b3-cadd-416f-abe7-cfd6e1717dca tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:56.076344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-19e694b3-cadd-416f-abe7-cfd6e1717dca tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:56.083198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-19e694b3-cadd-416f-abe7-cfd6e1717dca tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:56.083650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-19e694b3-cadd-416f-abe7-cfd6e1717dca tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:56.084458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-19e694b3-cadd-416f-abe7-cfd6e1717dca tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:56.084914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-19e694b3-cadd-416f-abe7-cfd6e1717dca tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:56.228642 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-19e694b3-cadd-416f-abe7-cfd6e1717dca tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:56.239626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-19e694b3-cadd-416f-abe7-cfd6e1717dca tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171735 Dec 15 16:29:56.240199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 525/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:56.475985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d24d576b-dd46-4d3f-adee-58ae7f9fffd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:56.476805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d24d576b-dd46-4d3f-adee-58ae7f9fffd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:56.483698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d24d576b-dd46-4d3f-adee-58ae7f9fffd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:56.484142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d24d576b-dd46-4d3f-adee-58ae7f9fffd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:56.484951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d24d576b-dd46-4d3f-adee-58ae7f9fffd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:56.485846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d24d576b-dd46-4d3f-adee-58ae7f9fffd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:56.517723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d24d576b-dd46-4d3f-adee-58ae7f9fffd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045747 Dec 15 16:29:56.518286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 552/1077] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:57.258312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-77b7da5d-22b7-4ddc-8178-401b69da4be4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:57.258988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-77b7da5d-22b7-4ddc-8178-401b69da4be4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:57.265711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-77b7da5d-22b7-4ddc-8178-401b69da4be4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:57.266161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-77b7da5d-22b7-4ddc-8178-401b69da4be4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:57.266961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-77b7da5d-22b7-4ddc-8178-401b69da4be4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:57.267379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-77b7da5d-22b7-4ddc-8178-401b69da4be4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:57.414741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-77b7da5d-22b7-4ddc-8178-401b69da4be4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:57.426174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-77b7da5d-22b7-4ddc-8178-401b69da4be4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171990 Dec 15 16:29:57.426860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 526/1078] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:57.532806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8d342a27-7e2e-4bc6-b984-8e85b6ca60ea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:57.533585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8d342a27-7e2e-4bc6-b984-8e85b6ca60ea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:57.541066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d342a27-7e2e-4bc6-b984-8e85b6ca60ea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:57.541510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d342a27-7e2e-4bc6-b984-8e85b6ca60ea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:57.542303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d342a27-7e2e-4bc6-b984-8e85b6ca60ea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:57.542738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d342a27-7e2e-4bc6-b984-8e85b6ca60ea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:57.575106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8d342a27-7e2e-4bc6-b984-8e85b6ca60ea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047939 Dec 15 16:29:57.575690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 553/1079] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:58.444999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8476008e-977b-4d35-8b99-4e745b890062 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:58.445904 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8476008e-977b-4d35-8b99-4e745b890062 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:58.457436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8476008e-977b-4d35-8b99-4e745b890062 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:58.458710 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8476008e-977b-4d35-8b99-4e745b890062 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:58.459611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8476008e-977b-4d35-8b99-4e745b890062 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:58.460104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8476008e-977b-4d35-8b99-4e745b890062 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:58.587118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3075df5d-a63b-4723-bf1f-1f5db1198ea1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:58.588025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3075df5d-a63b-4723-bf1f-1f5db1198ea1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:58.594406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3075df5d-a63b-4723-bf1f-1f5db1198ea1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:58.594857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3075df5d-a63b-4723-bf1f-1f5db1198ea1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:58.595651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3075df5d-a63b-4723-bf1f-1f5db1198ea1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:58.596083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3075df5d-a63b-4723-bf1f-1f5db1198ea1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:58.608233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8476008e-977b-4d35-8b99-4e745b890062 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:58.616381 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8476008e-977b-4d35-8b99-4e745b890062 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176274 Dec 15 16:29:58.616950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 527/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:58.626709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3075df5d-a63b-4723-bf1f-1f5db1198ea1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043361 Dec 15 16:29:58.627236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 554/1081] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:29:59.635239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-31357877-0f50-457b-9cd7-d67ed1ac8809 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:59.635992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-31357877-0f50-457b-9cd7-d67ed1ac8809 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:59.638114 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c65aa532-8c71-43d4-b412-d9a99ee6b4cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:59.639524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c65aa532-8c71-43d4-b412-d9a99ee6b4cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:59.642442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31357877-0f50-457b-9cd7-d67ed1ac8809 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:59.642906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31357877-0f50-457b-9cd7-d67ed1ac8809 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:59.643702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31357877-0f50-457b-9cd7-d67ed1ac8809 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:59.644143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31357877-0f50-457b-9cd7-d67ed1ac8809 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:59.645457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c65aa532-8c71-43d4-b412-d9a99ee6b4cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:59.645902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c65aa532-8c71-43d4-b412-d9a99ee6b4cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:59.646672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c65aa532-8c71-43d4-b412-d9a99ee6b4cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:59.647121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c65aa532-8c71-43d4-b412-d9a99ee6b4cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:59.678600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c65aa532-8c71-43d4-b412-d9a99ee6b4cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044035 Dec 15 16:29:59.679143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 555/1082] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:29:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:29:59.784807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-31357877-0f50-457b-9cd7-d67ed1ac8809 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:59.792929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-31357877-0f50-457b-9cd7-d67ed1ac8809 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.162010 Dec 15 16:29:59.793496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 528/1083] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:59 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:00.690576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-53edf701-ba57-4943-9cd5-e273eb6fd527 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:00.691484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-53edf701-ba57-4943-9cd5-e273eb6fd527 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:00.698619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53edf701-ba57-4943-9cd5-e273eb6fd527 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:00.699069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53edf701-ba57-4943-9cd5-e273eb6fd527 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:00.699894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53edf701-ba57-4943-9cd5-e273eb6fd527 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:00.700309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53edf701-ba57-4943-9cd5-e273eb6fd527 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:00.732819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-53edf701-ba57-4943-9cd5-e273eb6fd527 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045981 Dec 15 16:30:00.733425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 556/1084] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:00.811025 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9df0931d-d798-4745-9307-bedbfd5a8957 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:00.811662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9df0931d-d798-4745-9307-bedbfd5a8957 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:00.818475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9df0931d-d798-4745-9307-bedbfd5a8957 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:00.818954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9df0931d-d798-4745-9307-bedbfd5a8957 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:00.820584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9df0931d-d798-4745-9307-bedbfd5a8957 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:00.821026 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9df0931d-d798-4745-9307-bedbfd5a8957 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:00.970858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9df0931d-d798-4745-9307-bedbfd5a8957 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:00.978994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9df0931d-d798-4745-9307-bedbfd5a8957 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171747 Dec 15 16:30:00.979832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 529/1085] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:01.745436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d3d8a6ae-3293-4b7b-9ef8-2f33e2f2ec36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:01.746339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d3d8a6ae-3293-4b7b-9ef8-2f33e2f2ec36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:01.753435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6ae-3293-4b7b-9ef8-2f33e2f2ec36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:01.753868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6ae-3293-4b7b-9ef8-2f33e2f2ec36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:01.754680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6ae-3293-4b7b-9ef8-2f33e2f2ec36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:01.755114 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3d8a6ae-3293-4b7b-9ef8-2f33e2f2ec36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:01.786238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d3d8a6ae-3293-4b7b-9ef8-2f33e2f2ec36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044884 Dec 15 16:30:01.786847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 557/1086] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:01.996417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eda99f5d-293b-4c50-846b-beaa66a7172c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:01.997064 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eda99f5d-293b-4c50-846b-beaa66a7172c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:02.005001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eda99f5d-293b-4c50-846b-beaa66a7172c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:02.005521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eda99f5d-293b-4c50-846b-beaa66a7172c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:02.006264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eda99f5d-293b-4c50-846b-beaa66a7172c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:02.006707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eda99f5d-293b-4c50-846b-beaa66a7172c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:02.165238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eda99f5d-293b-4c50-846b-beaa66a7172c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:02.181470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eda99f5d-293b-4c50-846b-beaa66a7172c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.187799 Dec 15 16:30:02.182068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 530/1087] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:02.797715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c87cd655-ac33-4c6c-abfa-4f2923fb0154 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:02.798614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c87cd655-ac33-4c6c-abfa-4f2923fb0154 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:02.805680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c87cd655-ac33-4c6c-abfa-4f2923fb0154 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:02.806134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c87cd655-ac33-4c6c-abfa-4f2923fb0154 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:02.806916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c87cd655-ac33-4c6c-abfa-4f2923fb0154 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:02.807342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c87cd655-ac33-4c6c-abfa-4f2923fb0154 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:02.837048 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c87cd655-ac33-4c6c-abfa-4f2923fb0154 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043115 Dec 15 16:30:02.837601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 558/1088] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:03.200935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-48a2ca83-9c17-4e39-b633-64a885a2e60d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:03.201537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-48a2ca83-9c17-4e39-b633-64a885a2e60d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:03.208468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-48a2ca83-9c17-4e39-b633-64a885a2e60d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:03.208920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-48a2ca83-9c17-4e39-b633-64a885a2e60d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:03.209691 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-48a2ca83-9c17-4e39-b633-64a885a2e60d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:03.210116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-48a2ca83-9c17-4e39-b633-64a885a2e60d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:03.362922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-48a2ca83-9c17-4e39-b633-64a885a2e60d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:03.371279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-48a2ca83-9c17-4e39-b633-64a885a2e60d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174799 Dec 15 16:30:03.371830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 531/1089] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:03 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:03.849253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-83022985-0f3e-4d02-9f12-71b7c238790d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:03.850162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-83022985-0f3e-4d02-9f12-71b7c238790d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:03.857815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83022985-0f3e-4d02-9f12-71b7c238790d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:03.858236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83022985-0f3e-4d02-9f12-71b7c238790d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:03.859065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83022985-0f3e-4d02-9f12-71b7c238790d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:03.859660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83022985-0f3e-4d02-9f12-71b7c238790d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:03.899496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-83022985-0f3e-4d02-9f12-71b7c238790d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054064 Dec 15 16:30:03.900396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 559/1090] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:04.389569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fae4b4dc-0e27-4a80-9049-435b6f4b6516 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:04.390126 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fae4b4dc-0e27-4a80-9049-435b6f4b6516 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:04.396917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fae4b4dc-0e27-4a80-9049-435b6f4b6516 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:04.397367 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fae4b4dc-0e27-4a80-9049-435b6f4b6516 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:04.398165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fae4b4dc-0e27-4a80-9049-435b6f4b6516 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:04.398600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fae4b4dc-0e27-4a80-9049-435b6f4b6516 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:04.541891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fae4b4dc-0e27-4a80-9049-435b6f4b6516 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:04.550152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fae4b4dc-0e27-4a80-9049-435b6f4b6516 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.164398 Dec 15 16:30:04.552326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 532/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:04.914204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e51d617e-b10a-4924-9bb6-f0cada445b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:04.915404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e51d617e-b10a-4924-9bb6-f0cada445b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:04.923205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e51d617e-b10a-4924-9bb6-f0cada445b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:04.923651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e51d617e-b10a-4924-9bb6-f0cada445b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:04.924481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e51d617e-b10a-4924-9bb6-f0cada445b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:04.924903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e51d617e-b10a-4924-9bb6-f0cada445b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:04.957506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e51d617e-b10a-4924-9bb6-f0cada445b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049083 Dec 15 16:30:04.958084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 560/1092] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:05.570203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-92ee3df6-a712-4844-9fe6-62ac2cc7a2e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:05.570919 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-92ee3df6-a712-4844-9fe6-62ac2cc7a2e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:05.577828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92ee3df6-a712-4844-9fe6-62ac2cc7a2e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:05.578282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92ee3df6-a712-4844-9fe6-62ac2cc7a2e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:05.579079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92ee3df6-a712-4844-9fe6-62ac2cc7a2e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:05.579514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92ee3df6-a712-4844-9fe6-62ac2cc7a2e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:05.724769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-92ee3df6-a712-4844-9fe6-62ac2cc7a2e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:05.735835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-92ee3df6-a712-4844-9fe6-62ac2cc7a2e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170872 Dec 15 16:30:05.736572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 533/1093] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:05.974068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-835dcff7-2dbd-4638-9030-d120b42259ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:05.975362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-835dcff7-2dbd-4638-9030-d120b42259ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:05.986780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-835dcff7-2dbd-4638-9030-d120b42259ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:05.987534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-835dcff7-2dbd-4638-9030-d120b42259ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:05.988880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-835dcff7-2dbd-4638-9030-d120b42259ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:05.989595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-835dcff7-2dbd-4638-9030-d120b42259ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:06.023254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-835dcff7-2dbd-4638-9030-d120b42259ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055792 Dec 15 16:30:06.023818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 561/1094] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:06.754011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c71fabfb-90bc-41c4-b328-4d1f564006b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:06.754687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c71fabfb-90bc-41c4-b328-4d1f564006b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:06.761684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c71fabfb-90bc-41c4-b328-4d1f564006b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:06.762139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c71fabfb-90bc-41c4-b328-4d1f564006b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:06.762926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c71fabfb-90bc-41c4-b328-4d1f564006b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:06.763371 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c71fabfb-90bc-41c4-b328-4d1f564006b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:06.909803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c71fabfb-90bc-41c4-b328-4d1f564006b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:06.918675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c71fabfb-90bc-41c4-b328-4d1f564006b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168388 Dec 15 16:30:06.919243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 534/1095] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:07.037596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e4882395-c49c-41f7-b242-184032c6f987 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:07.038672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e4882395-c49c-41f7-b242-184032c6f987 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:07.046009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e4882395-c49c-41f7-b242-184032c6f987 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:07.046454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e4882395-c49c-41f7-b242-184032c6f987 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:07.047234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e4882395-c49c-41f7-b242-184032c6f987 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:07.047672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e4882395-c49c-41f7-b242-184032c6f987 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:07.077453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e4882395-c49c-41f7-b242-184032c6f987 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045806 Dec 15 16:30:07.078019 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 562/1096] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:07.936816 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f32decfb-bdb8-4353-8ea9-db2fe1e5c09b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:07.937413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f32decfb-bdb8-4353-8ea9-db2fe1e5c09b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:07.944051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f32decfb-bdb8-4353-8ea9-db2fe1e5c09b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:07.944567 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f32decfb-bdb8-4353-8ea9-db2fe1e5c09b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:07.945343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f32decfb-bdb8-4353-8ea9-db2fe1e5c09b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:07.945770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f32decfb-bdb8-4353-8ea9-db2fe1e5c09b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:08.089846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f32decfb-bdb8-4353-8ea9-db2fe1e5c09b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:08.091600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-90333670-736e-4839-905b-d89406d6997e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:08.092691 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-90333670-736e-4839-905b-d89406d6997e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:08.097727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f32decfb-bdb8-4353-8ea9-db2fe1e5c09b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.164834 Dec 15 16:30:08.098276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 535/1097] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:07 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:08.098989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90333670-736e-4839-905b-d89406d6997e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:08.099570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90333670-736e-4839-905b-d89406d6997e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:08.100365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90333670-736e-4839-905b-d89406d6997e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:08.100823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-90333670-736e-4839-905b-d89406d6997e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:08.131978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-90333670-736e-4839-905b-d89406d6997e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044275 Dec 15 16:30:08.132609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 563/1098] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:09.117506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b7c98e80-ab18-4617-9d0c-0388f9f465be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:09.118194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b7c98e80-ab18-4617-9d0c-0388f9f465be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:09.129282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7c98e80-ab18-4617-9d0c-0388f9f465be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:09.129840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7c98e80-ab18-4617-9d0c-0388f9f465be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:09.131049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7c98e80-ab18-4617-9d0c-0388f9f465be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:09.131655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7c98e80-ab18-4617-9d0c-0388f9f465be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:09.143828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9e8dfde9-dc5e-4072-a79c-ef3e1f4bb60f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:09.144730 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9e8dfde9-dc5e-4072-a79c-ef3e1f4bb60f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:09.152056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e8dfde9-dc5e-4072-a79c-ef3e1f4bb60f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:09.152846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e8dfde9-dc5e-4072-a79c-ef3e1f4bb60f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:09.153905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e8dfde9-dc5e-4072-a79c-ef3e1f4bb60f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:09.154362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e8dfde9-dc5e-4072-a79c-ef3e1f4bb60f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:09.188814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9e8dfde9-dc5e-4072-a79c-ef3e1f4bb60f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048691 Dec 15 16:30:09.189632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 564/1099] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:09.279574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b7c98e80-ab18-4617-9d0c-0388f9f465be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:09.287531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b7c98e80-ab18-4617-9d0c-0388f9f465be tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.175705 Dec 15 16:30:09.288109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 536/1100] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:10.201479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4b019689-aa55-40ea-882d-b8d034324937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:10.202367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4b019689-aa55-40ea-882d-b8d034324937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:10.209061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b019689-aa55-40ea-882d-b8d034324937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:10.209535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b019689-aa55-40ea-882d-b8d034324937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:10.210463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b019689-aa55-40ea-882d-b8d034324937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:10.211008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b019689-aa55-40ea-882d-b8d034324937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:10.244500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4b019689-aa55-40ea-882d-b8d034324937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047053 Dec 15 16:30:10.245119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 565/1101] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:10.308459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f3a7a8ed-c1e5-4c6f-b604-b2e1c206926c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:10.309152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f3a7a8ed-c1e5-4c6f-b604-b2e1c206926c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:10.315806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3a7a8ed-c1e5-4c6f-b604-b2e1c206926c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:10.316254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3a7a8ed-c1e5-4c6f-b604-b2e1c206926c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:10.317068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3a7a8ed-c1e5-4c6f-b604-b2e1c206926c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:10.317480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3a7a8ed-c1e5-4c6f-b604-b2e1c206926c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:10.461009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f3a7a8ed-c1e5-4c6f-b604-b2e1c206926c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:10.469532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f3a7a8ed-c1e5-4c6f-b604-b2e1c206926c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166650 Dec 15 16:30:10.470107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 537/1102] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:30:11.256789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c95a7ea2-a442-4a5e-9796-badda1f1221c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:11.257705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c95a7ea2-a442-4a5e-9796-badda1f1221c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:11.264821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c95a7ea2-a442-4a5e-9796-badda1f1221c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.265243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c95a7ea2-a442-4a5e-9796-badda1f1221c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.266050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c95a7ea2-a442-4a5e-9796-badda1f1221c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.266495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c95a7ea2-a442-4a5e-9796-badda1f1221c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.298298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c95a7ea2-a442-4a5e-9796-badda1f1221c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045325 Dec 15 16:30:11.298894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 566/1103] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:11.488050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cd9e205e-28b8-4744-8104-55529f8f9bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:11.488722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cd9e205e-28b8-4744-8104-55529f8f9bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:11.495402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd9e205e-28b8-4744-8104-55529f8f9bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.495997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd9e205e-28b8-4744-8104-55529f8f9bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.496685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd9e205e-28b8-4744-8104-55529f8f9bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.497111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd9e205e-28b8-4744-8104-55529f8f9bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.639006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cd9e205e-28b8-4744-8104-55529f8f9bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:11.648612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cd9e205e-28b8-4744-8104-55529f8f9bb7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.164046 Dec 15 16:30:11.649269 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 538/1104] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:11 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:12.312245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8ef76a4f-4d0a-4bb9-92c7-a10dcad7bb93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:12.313561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8ef76a4f-4d0a-4bb9-92c7-a10dcad7bb93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:12.321784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ef76a4f-4d0a-4bb9-92c7-a10dcad7bb93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:12.322655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ef76a4f-4d0a-4bb9-92c7-a10dcad7bb93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:12.323665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ef76a4f-4d0a-4bb9-92c7-a10dcad7bb93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:12.324136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ef76a4f-4d0a-4bb9-92c7-a10dcad7bb93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:12.357196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8ef76a4f-4d0a-4bb9-92c7-a10dcad7bb93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050499 Dec 15 16:30:12.357736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 567/1105] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:12.667228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f7ba7e3c-e7e4-482d-8b67-8e33ba989a19 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:12.667883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f7ba7e3c-e7e4-482d-8b67-8e33ba989a19 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:12.674839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7ba7e3c-e7e4-482d-8b67-8e33ba989a19 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:12.675291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7ba7e3c-e7e4-482d-8b67-8e33ba989a19 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:12.676061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7ba7e3c-e7e4-482d-8b67-8e33ba989a19 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:12.676495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7ba7e3c-e7e4-482d-8b67-8e33ba989a19 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:12.835613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f7ba7e3c-e7e4-482d-8b67-8e33ba989a19 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:12.846078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f7ba7e3c-e7e4-482d-8b67-8e33ba989a19 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.182553 Dec 15 16:30:12.846672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 539/1106] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:12 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:13.368796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6b610445-6937-4882-88a9-73eb294a7f0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:13.370463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6b610445-6937-4882-88a9-73eb294a7f0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:13.377897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6b610445-6937-4882-88a9-73eb294a7f0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:13.378251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6b610445-6937-4882-88a9-73eb294a7f0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:13.379053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6b610445-6937-4882-88a9-73eb294a7f0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:13.379485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6b610445-6937-4882-88a9-73eb294a7f0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:13.412772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6b610445-6937-4882-88a9-73eb294a7f0f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047348 Dec 15 16:30:13.413772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 568/1107] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:13.863331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eac85c4d-f1c0-4036-ac5e-9a38ba213054 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:13.864858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eac85c4d-f1c0-4036-ac5e-9a38ba213054 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:13.873818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eac85c4d-f1c0-4036-ac5e-9a38ba213054 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:13.874618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eac85c4d-f1c0-4036-ac5e-9a38ba213054 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:13.875463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eac85c4d-f1c0-4036-ac5e-9a38ba213054 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:13.875898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eac85c4d-f1c0-4036-ac5e-9a38ba213054 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:14.026950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eac85c4d-f1c0-4036-ac5e-9a38ba213054 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:14.034826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eac85c4d-f1c0-4036-ac5e-9a38ba213054 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.175284 Dec 15 16:30:14.035403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 540/1108] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:30:14.427992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e638eee3-a5d0-436c-b08f-c6cc28d3bed5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:14.428839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e638eee3-a5d0-436c-b08f-c6cc28d3bed5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:14.436287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e638eee3-a5d0-436c-b08f-c6cc28d3bed5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:14.437058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e638eee3-a5d0-436c-b08f-c6cc28d3bed5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:14.438298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e638eee3-a5d0-436c-b08f-c6cc28d3bed5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:14.438962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e638eee3-a5d0-436c-b08f-c6cc28d3bed5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:14.474117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e638eee3-a5d0-436c-b08f-c6cc28d3bed5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050042 Dec 15 16:30:14.474699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 569/1109] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:15.053037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e217deab-ba5e-4486-904d-a63a6f7dbe83 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:15.053647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e217deab-ba5e-4486-904d-a63a6f7dbe83 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:15.060576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e217deab-ba5e-4486-904d-a63a6f7dbe83 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:15.061041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e217deab-ba5e-4486-904d-a63a6f7dbe83 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:15.061969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e217deab-ba5e-4486-904d-a63a6f7dbe83 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:15.062553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e217deab-ba5e-4486-904d-a63a6f7dbe83 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:15.208457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e217deab-ba5e-4486-904d-a63a6f7dbe83 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:15.217388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e217deab-ba5e-4486-904d-a63a6f7dbe83 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168712 Dec 15 16:30:15.217988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 541/1110] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:30:15.487804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e23e1a21-6f32-4c32-940d-c46dd0e5088b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:15.488882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e23e1a21-6f32-4c32-940d-c46dd0e5088b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:15.496471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e23e1a21-6f32-4c32-940d-c46dd0e5088b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:15.497285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e23e1a21-6f32-4c32-940d-c46dd0e5088b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:15.498680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e23e1a21-6f32-4c32-940d-c46dd0e5088b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:15.499821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e23e1a21-6f32-4c32-940d-c46dd0e5088b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:15.533919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e23e1a21-6f32-4c32-940d-c46dd0e5088b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051038 Dec 15 16:30:15.534437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 570/1111] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:16.240378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1d4dd7ee-f108-48a9-b891-d7b8012e2d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:16.241104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1d4dd7ee-f108-48a9-b891-d7b8012e2d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:16.249627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d4dd7ee-f108-48a9-b891-d7b8012e2d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:16.250106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d4dd7ee-f108-48a9-b891-d7b8012e2d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:16.250901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d4dd7ee-f108-48a9-b891-d7b8012e2d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:16.251341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d4dd7ee-f108-48a9-b891-d7b8012e2d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:16.406519 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1d4dd7ee-f108-48a9-b891-d7b8012e2d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:16.417599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1d4dd7ee-f108-48a9-b891-d7b8012e2d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.182983 Dec 15 16:30:16.418172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 542/1112] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:16 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:16.547050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7b3958a1-4dd2-41c1-8ebc-2005fa7411ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:16.547899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7b3958a1-4dd2-41c1-8ebc-2005fa7411ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:16.555611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b3958a1-4dd2-41c1-8ebc-2005fa7411ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:16.556198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b3958a1-4dd2-41c1-8ebc-2005fa7411ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:16.557619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b3958a1-4dd2-41c1-8ebc-2005fa7411ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:16.558414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b3958a1-4dd2-41c1-8ebc-2005fa7411ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:16.589354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7b3958a1-4dd2-41c1-8ebc-2005fa7411ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047099 Dec 15 16:30:16.589970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 571/1113] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:16 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:17.435143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5bf944d1-6b15-49a6-a6d9-7daa56a5910e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:17.435773 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5bf944d1-6b15-49a6-a6d9-7daa56a5910e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:17.442334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5bf944d1-6b15-49a6-a6d9-7daa56a5910e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:17.442774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5bf944d1-6b15-49a6-a6d9-7daa56a5910e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:17.443553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5bf944d1-6b15-49a6-a6d9-7daa56a5910e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:17.443997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5bf944d1-6b15-49a6-a6d9-7daa56a5910e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:17.586175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5bf944d1-6b15-49a6-a6d9-7daa56a5910e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:17.597324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5bf944d1-6b15-49a6-a6d9-7daa56a5910e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165956 Dec 15 16:30:17.598003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 543/1114] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:17 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:17.601133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-344e9d31-4987-4839-b0da-6193f82c3e12 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:17.602075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-344e9d31-4987-4839-b0da-6193f82c3e12 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:17.608908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-344e9d31-4987-4839-b0da-6193f82c3e12 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:17.609362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-344e9d31-4987-4839-b0da-6193f82c3e12 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:17.610159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-344e9d31-4987-4839-b0da-6193f82c3e12 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:17.610596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-344e9d31-4987-4839-b0da-6193f82c3e12 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:17.642221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-344e9d31-4987-4839-b0da-6193f82c3e12 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044748 Dec 15 16:30:17.642780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 572/1115] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:18.614732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-27a2b2b3-1574-41d1-aafe-d92849caac5f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:18.615369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-27a2b2b3-1574-41d1-aafe-d92849caac5f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:18.622261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27a2b2b3-1574-41d1-aafe-d92849caac5f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:18.622738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27a2b2b3-1574-41d1-aafe-d92849caac5f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:18.623711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27a2b2b3-1574-41d1-aafe-d92849caac5f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:18.624168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27a2b2b3-1574-41d1-aafe-d92849caac5f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:18.654169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-06ecc636-a2f6-4604-9cbe-aab4dab67b57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:18.655047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-06ecc636-a2f6-4604-9cbe-aab4dab67b57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:18.662055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06ecc636-a2f6-4604-9cbe-aab4dab67b57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:18.662502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06ecc636-a2f6-4604-9cbe-aab4dab67b57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:18.663305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06ecc636-a2f6-4604-9cbe-aab4dab67b57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:18.663737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06ecc636-a2f6-4604-9cbe-aab4dab67b57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:18.695576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-06ecc636-a2f6-4604-9cbe-aab4dab67b57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045222 Dec 15 16:30:18.696156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 573/1116] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:18.761134 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-27a2b2b3-1574-41d1-aafe-d92849caac5f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:18.769198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-27a2b2b3-1574-41d1-aafe-d92849caac5f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.158098 Dec 15 16:30:18.769774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 544/1117] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:19.707668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dd061288-8aa4-4e2b-b8e6-a52c3d068e4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:19.708621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dd061288-8aa4-4e2b-b8e6-a52c3d068e4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:19.715470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd061288-8aa4-4e2b-b8e6-a52c3d068e4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:19.715908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd061288-8aa4-4e2b-b8e6-a52c3d068e4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:19.716734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd061288-8aa4-4e2b-b8e6-a52c3d068e4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:19.717156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd061288-8aa4-4e2b-b8e6-a52c3d068e4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:19.750043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dd061288-8aa4-4e2b-b8e6-a52c3d068e4e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046122 Dec 15 16:30:19.750638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 574/1118] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:19.786661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c5727665-b6a8-473d-b7ed-6103683f3d16 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:19.787254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c5727665-b6a8-473d-b7ed-6103683f3d16 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:19.793882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5727665-b6a8-473d-b7ed-6103683f3d16 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:19.794326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5727665-b6a8-473d-b7ed-6103683f3d16 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:19.795108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5727665-b6a8-473d-b7ed-6103683f3d16 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:19.795566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5727665-b6a8-473d-b7ed-6103683f3d16 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:19.945325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c5727665-b6a8-473d-b7ed-6103683f3d16 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:19.953971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c5727665-b6a8-473d-b7ed-6103683f3d16 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170918 Dec 15 16:30:19.954563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 545/1119] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:20.762402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bda85d21-5d6e-40ad-aa15-72fe5dc34270 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:20.763321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bda85d21-5d6e-40ad-aa15-72fe5dc34270 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:20.770158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bda85d21-5d6e-40ad-aa15-72fe5dc34270 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:20.770606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bda85d21-5d6e-40ad-aa15-72fe5dc34270 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:20.771402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bda85d21-5d6e-40ad-aa15-72fe5dc34270 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:20.771840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bda85d21-5d6e-40ad-aa15-72fe5dc34270 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:20.803375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bda85d21-5d6e-40ad-aa15-72fe5dc34270 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044855 Dec 15 16:30:20.803931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 575/1120] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:20.971740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9c272533-d8a9-4080-808e-a0151ed568ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:20.972918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9c272533-d8a9-4080-808e-a0151ed568ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:20.979626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9c272533-d8a9-4080-808e-a0151ed568ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:20.980080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9c272533-d8a9-4080-808e-a0151ed568ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:20.980923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9c272533-d8a9-4080-808e-a0151ed568ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:20.981365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9c272533-d8a9-4080-808e-a0151ed568ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:21.125736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9c272533-d8a9-4080-808e-a0151ed568ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:21.134075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9c272533-d8a9-4080-808e-a0151ed568ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166313 Dec 15 16:30:21.134887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 546/1121] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:20 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:21.816162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-83b148b3-d1e3-44b0-ba1b-ff74c2f69621 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:21.817074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-83b148b3-d1e3-44b0-ba1b-ff74c2f69621 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:21.824135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83b148b3-d1e3-44b0-ba1b-ff74c2f69621 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:21.824629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83b148b3-d1e3-44b0-ba1b-ff74c2f69621 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:21.825435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83b148b3-d1e3-44b0-ba1b-ff74c2f69621 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:21.825865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83b148b3-d1e3-44b0-ba1b-ff74c2f69621 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:21.859225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-83b148b3-d1e3-44b0-ba1b-ff74c2f69621 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046588 Dec 15 16:30:21.860088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 576/1122] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:22.153003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-077b70e4-3be5-4b26-900c-88ce2af76b07 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:22.153616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-077b70e4-3be5-4b26-900c-88ce2af76b07 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:22.160829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-077b70e4-3be5-4b26-900c-88ce2af76b07 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:22.161279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-077b70e4-3be5-4b26-900c-88ce2af76b07 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:22.162133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-077b70e4-3be5-4b26-900c-88ce2af76b07 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:22.162568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-077b70e4-3be5-4b26-900c-88ce2af76b07 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:22.314909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-077b70e4-3be5-4b26-900c-88ce2af76b07 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:22.323811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-077b70e4-3be5-4b26-900c-88ce2af76b07 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174665 Dec 15 16:30:22.324768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 547/1123] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:22 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:22.875381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-15032487-1c39-4fa4-9f37-89454c4d969b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:22.876884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-15032487-1c39-4fa4-9f37-89454c4d969b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:22.883966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15032487-1c39-4fa4-9f37-89454c4d969b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:22.884405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15032487-1c39-4fa4-9f37-89454c4d969b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:22.885236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15032487-1c39-4fa4-9f37-89454c4d969b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:22.885657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15032487-1c39-4fa4-9f37-89454c4d969b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:22.921153 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-15032487-1c39-4fa4-9f37-89454c4d969b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051015 Dec 15 16:30:22.921728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 577/1124] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:23.348492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2bf9d50c-f774-4759-baf9-4df226a50de2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:23.349122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2bf9d50c-f774-4759-baf9-4df226a50de2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:23.357766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2bf9d50c-f774-4759-baf9-4df226a50de2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:23.358288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2bf9d50c-f774-4759-baf9-4df226a50de2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:23.359081 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2bf9d50c-f774-4759-baf9-4df226a50de2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:23.359511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2bf9d50c-f774-4759-baf9-4df226a50de2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:23.505904 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2bf9d50c-f774-4759-baf9-4df226a50de2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:23.513690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2bf9d50c-f774-4759-baf9-4df226a50de2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170494 Dec 15 16:30:23.514508 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 548/1125] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:23 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:23.933713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cb951c34-cee5-4997-9a09-7424b0f53a7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:23.934605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cb951c34-cee5-4997-9a09-7424b0f53a7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:23.941477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb951c34-cee5-4997-9a09-7424b0f53a7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:23.941917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb951c34-cee5-4997-9a09-7424b0f53a7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:23.942719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb951c34-cee5-4997-9a09-7424b0f53a7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:23.943148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb951c34-cee5-4997-9a09-7424b0f53a7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:23.975159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cb951c34-cee5-4997-9a09-7424b0f53a7d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045713 Dec 15 16:30:23.975743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 578/1126] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:24.532202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2037151f-b468-40e7-ba0a-ac858603bf88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:24.532957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2037151f-b468-40e7-ba0a-ac858603bf88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:24.544285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2037151f-b468-40e7-ba0a-ac858603bf88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:24.544740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2037151f-b468-40e7-ba0a-ac858603bf88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:24.545572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2037151f-b468-40e7-ba0a-ac858603bf88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:24.545997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2037151f-b468-40e7-ba0a-ac858603bf88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:24.691335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2037151f-b468-40e7-ba0a-ac858603bf88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:24.700067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2037151f-b468-40e7-ba0a-ac858603bf88 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171582 Dec 15 16:30:24.701956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 549/1127] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:24.990629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-19b711de-5880-48e2-a445-f15028319319 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:24.991481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-19b711de-5880-48e2-a445-f15028319319 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:25.001572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-19b711de-5880-48e2-a445-f15028319319 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:25.002112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-19b711de-5880-48e2-a445-f15028319319 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:25.002905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-19b711de-5880-48e2-a445-f15028319319 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:25.003630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-19b711de-5880-48e2-a445-f15028319319 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:25.044846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-19b711de-5880-48e2-a445-f15028319319 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061118 Dec 15 16:30:25.045447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 579/1128] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:25.719346 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-006b456a-8246-487b-9afc-2a397090a313 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:25.720412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-006b456a-8246-487b-9afc-2a397090a313 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:25.727063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-006b456a-8246-487b-9afc-2a397090a313 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:25.727511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-006b456a-8246-487b-9afc-2a397090a313 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:25.728325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-006b456a-8246-487b-9afc-2a397090a313 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:25.728763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-006b456a-8246-487b-9afc-2a397090a313 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:25.879111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-006b456a-8246-487b-9afc-2a397090a313 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:25.887680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-006b456a-8246-487b-9afc-2a397090a313 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173112 Dec 15 16:30:25.888301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 550/1129] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:26.057956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5a48212b-3918-4e6a-b625-d7bfcd57a295 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:26.059585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5a48212b-3918-4e6a-b625-d7bfcd57a295 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:26.067397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a48212b-3918-4e6a-b625-d7bfcd57a295 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:26.067713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a48212b-3918-4e6a-b625-d7bfcd57a295 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:26.068901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a48212b-3918-4e6a-b625-d7bfcd57a295 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:26.069465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a48212b-3918-4e6a-b625-d7bfcd57a295 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:26.105431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5a48212b-3918-4e6a-b625-d7bfcd57a295 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051231 Dec 15 16:30:26.106000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 580/1130] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:26.906163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-272c403d-0344-4221-838d-d63fd3c9ec4c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:26.906784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-272c403d-0344-4221-838d-d63fd3c9ec4c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:26.914163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-272c403d-0344-4221-838d-d63fd3c9ec4c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:26.914673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-272c403d-0344-4221-838d-d63fd3c9ec4c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:26.915514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-272c403d-0344-4221-838d-d63fd3c9ec4c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:26.915958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-272c403d-0344-4221-838d-d63fd3c9ec4c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:27.072613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-272c403d-0344-4221-838d-d63fd3c9ec4c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:27.082586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-272c403d-0344-4221-838d-d63fd3c9ec4c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.180151 Dec 15 16:30:27.083190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 551/1131] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:26 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:27.118940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3cf492b8-ef53-4e43-befe-408fe194755e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:27.120111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3cf492b8-ef53-4e43-befe-408fe194755e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:27.127126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cf492b8-ef53-4e43-befe-408fe194755e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:27.127571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cf492b8-ef53-4e43-befe-408fe194755e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:27.128365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cf492b8-ef53-4e43-befe-408fe194755e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:27.128834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cf492b8-ef53-4e43-befe-408fe194755e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:27.160929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3cf492b8-ef53-4e43-befe-408fe194755e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045408 Dec 15 16:30:27.161315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 581/1132] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:28.099843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-15897c47-f667-46ef-8a2f-3045ec101dba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:28.100450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-15897c47-f667-46ef-8a2f-3045ec101dba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:28.107452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-15897c47-f667-46ef-8a2f-3045ec101dba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:28.108399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-15897c47-f667-46ef-8a2f-3045ec101dba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:28.109233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-15897c47-f667-46ef-8a2f-3045ec101dba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:28.109675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-15897c47-f667-46ef-8a2f-3045ec101dba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:28.171576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9673e257-043c-44b1-8284-4522f974cd14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:28.172612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9673e257-043c-44b1-8284-4522f974cd14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:28.179701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9673e257-043c-44b1-8284-4522f974cd14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:28.180145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9673e257-043c-44b1-8284-4522f974cd14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:28.183839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9673e257-043c-44b1-8284-4522f974cd14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:28.183839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9673e257-043c-44b1-8284-4522f974cd14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:28.213709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9673e257-043c-44b1-8284-4522f974cd14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045958 Dec 15 16:30:28.214332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 582/1133] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:28.256787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-15897c47-f667-46ef-8a2f-3045ec101dba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:28.265013 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-15897c47-f667-46ef-8a2f-3045ec101dba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168885 Dec 15 16:30:28.265593 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 552/1134] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:29.229722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aa802520-36c1-4146-97c8-f50458a335a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:29.230850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aa802520-36c1-4146-97c8-f50458a335a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:29.238179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa802520-36c1-4146-97c8-f50458a335a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:29.238601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa802520-36c1-4146-97c8-f50458a335a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:29.239430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa802520-36c1-4146-97c8-f50458a335a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:29.239858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa802520-36c1-4146-97c8-f50458a335a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:29.270565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aa802520-36c1-4146-97c8-f50458a335a2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046534 Dec 15 16:30:29.271135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 583/1135] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:29.283114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-47beed56-a03d-430e-bbf5-8a8be0e91cd4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:29.283818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-47beed56-a03d-430e-bbf5-8a8be0e91cd4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:29.290871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47beed56-a03d-430e-bbf5-8a8be0e91cd4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:29.291318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47beed56-a03d-430e-bbf5-8a8be0e91cd4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:29.292111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47beed56-a03d-430e-bbf5-8a8be0e91cd4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:29.292585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47beed56-a03d-430e-bbf5-8a8be0e91cd4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:29.448414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-47beed56-a03d-430e-bbf5-8a8be0e91cd4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:29.457384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-47beed56-a03d-430e-bbf5-8a8be0e91cd4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.178015 Dec 15 16:30:29.457952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 553/1136] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:30.284076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d1950312-65d6-47fb-9950-245930820c5d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:30.285006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d1950312-65d6-47fb-9950-245930820c5d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:30.292046 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1950312-65d6-47fb-9950-245930820c5d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:30.292540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1950312-65d6-47fb-9950-245930820c5d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:30.293372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1950312-65d6-47fb-9950-245930820c5d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:30.294013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1950312-65d6-47fb-9950-245930820c5d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:30.331771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d1950312-65d6-47fb-9950-245930820c5d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051580 Dec 15 16:30:30.332342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 584/1137] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:30.474680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-57fba925-93d1-4ee1-9b43-cf397b86a5ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:30.475312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-57fba925-93d1-4ee1-9b43-cf397b86a5ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:30.481723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57fba925-93d1-4ee1-9b43-cf397b86a5ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:30.482175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57fba925-93d1-4ee1-9b43-cf397b86a5ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:30.483130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57fba925-93d1-4ee1-9b43-cf397b86a5ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:30.483621 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57fba925-93d1-4ee1-9b43-cf397b86a5ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:30.632578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-57fba925-93d1-4ee1-9b43-cf397b86a5ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:30.640632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-57fba925-93d1-4ee1-9b43-cf397b86a5ea tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169658 Dec 15 16:30:30.641300 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 554/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:30 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:31.343763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-478f1288-ab45-412b-bed4-acfed1cad716 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:31.344696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-478f1288-ab45-412b-bed4-acfed1cad716 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:31.353024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-478f1288-ab45-412b-bed4-acfed1cad716 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:31.353986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-478f1288-ab45-412b-bed4-acfed1cad716 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:31.355096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-478f1288-ab45-412b-bed4-acfed1cad716 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:31.355822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-478f1288-ab45-412b-bed4-acfed1cad716 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:31.390343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-478f1288-ab45-412b-bed4-acfed1cad716 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050581 Dec 15 16:30:31.390839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 585/1139] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:31.658626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b5546180-9915-4a8a-bb61-0ef91243ff24 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:31.659218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b5546180-9915-4a8a-bb61-0ef91243ff24 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:31.666119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5546180-9915-4a8a-bb61-0ef91243ff24 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:31.666562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5546180-9915-4a8a-bb61-0ef91243ff24 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:31.667350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5546180-9915-4a8a-bb61-0ef91243ff24 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:31.667775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5546180-9915-4a8a-bb61-0ef91243ff24 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:31.805263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b5546180-9915-4a8a-bb61-0ef91243ff24 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:31.813466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b5546180-9915-4a8a-bb61-0ef91243ff24 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.158669 Dec 15 16:30:31.814053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 555/1140] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:31 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:32.402897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9ad939b8-c837-4dbe-89ce-2367b9aa090c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:32.403704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9ad939b8-c837-4dbe-89ce-2367b9aa090c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:32.410872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ad939b8-c837-4dbe-89ce-2367b9aa090c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:32.411319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ad939b8-c837-4dbe-89ce-2367b9aa090c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:32.412095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ad939b8-c837-4dbe-89ce-2367b9aa090c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:32.412588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ad939b8-c837-4dbe-89ce-2367b9aa090c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:32.447032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9ad939b8-c837-4dbe-89ce-2367b9aa090c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048275 Dec 15 16:30:32.447612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 586/1141] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:32.831633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5158b463-803b-4259-8e0a-1b64b0e33892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:32.832305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5158b463-803b-4259-8e0a-1b64b0e33892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:32.839162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5158b463-803b-4259-8e0a-1b64b0e33892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:32.839606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5158b463-803b-4259-8e0a-1b64b0e33892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:32.840394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5158b463-803b-4259-8e0a-1b64b0e33892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:32.840851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5158b463-803b-4259-8e0a-1b64b0e33892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:32.977018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5158b463-803b-4259-8e0a-1b64b0e33892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:32.985057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5158b463-803b-4259-8e0a-1b64b0e33892 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.157481 Dec 15 16:30:32.985646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 556/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:30:33.459185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-60249fa7-0154-404a-a0c0-985a5bb1c83f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:33.459964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-60249fa7-0154-404a-a0c0-985a5bb1c83f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:33.466300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60249fa7-0154-404a-a0c0-985a5bb1c83f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:33.466839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60249fa7-0154-404a-a0c0-985a5bb1c83f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:33.467788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60249fa7-0154-404a-a0c0-985a5bb1c83f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:33.468257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60249fa7-0154-404a-a0c0-985a5bb1c83f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:33.503160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-60249fa7-0154-404a-a0c0-985a5bb1c83f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048052 Dec 15 16:30:33.503738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 587/1143] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:34.003031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3a5ac699-22f8-429e-9f7f-c9e0e954814b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:34.003675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3a5ac699-22f8-429e-9f7f-c9e0e954814b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:34.010552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a5ac699-22f8-429e-9f7f-c9e0e954814b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:34.011036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a5ac699-22f8-429e-9f7f-c9e0e954814b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:34.011943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a5ac699-22f8-429e-9f7f-c9e0e954814b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:34.012467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a5ac699-22f8-429e-9f7f-c9e0e954814b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:34.168021 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3a5ac699-22f8-429e-9f7f-c9e0e954814b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:34.178065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3a5ac699-22f8-429e-9f7f-c9e0e954814b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.178461 Dec 15 16:30:34.178768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 557/1144] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:34.516795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4f7375de-8923-41b5-9ea4-8d4139138a00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:34.517709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4f7375de-8923-41b5-9ea4-8d4139138a00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:34.526536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4f7375de-8923-41b5-9ea4-8d4139138a00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:34.527199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4f7375de-8923-41b5-9ea4-8d4139138a00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:34.528001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4f7375de-8923-41b5-9ea4-8d4139138a00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:34.528416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4f7375de-8923-41b5-9ea4-8d4139138a00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:34.562579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4f7375de-8923-41b5-9ea4-8d4139138a00 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051094 Dec 15 16:30:34.563168 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 588/1145] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:35.200850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ed16a9ff-2deb-4c89-9eed-90bade3f766e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:35.201716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ed16a9ff-2deb-4c89-9eed-90bade3f766e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:35.209950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed16a9ff-2deb-4c89-9eed-90bade3f766e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:35.210387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed16a9ff-2deb-4c89-9eed-90bade3f766e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:35.211197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed16a9ff-2deb-4c89-9eed-90bade3f766e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:35.211637 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed16a9ff-2deb-4c89-9eed-90bade3f766e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:35.388808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ed16a9ff-2deb-4c89-9eed-90bade3f766e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:35.397961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ed16a9ff-2deb-4c89-9eed-90bade3f766e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.204086 Dec 15 16:30:35.398550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 558/1146] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:35.575167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aec8aa20-be1e-46f3-8097-bf721e0d6fec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:35.576464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aec8aa20-be1e-46f3-8097-bf721e0d6fec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:35.583367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aec8aa20-be1e-46f3-8097-bf721e0d6fec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:35.583813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aec8aa20-be1e-46f3-8097-bf721e0d6fec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:35.584631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aec8aa20-be1e-46f3-8097-bf721e0d6fec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:35.585060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aec8aa20-be1e-46f3-8097-bf721e0d6fec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:35.616229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aec8aa20-be1e-46f3-8097-bf721e0d6fec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045341 Dec 15 16:30:35.616828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 589/1147] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:36.415736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7f99251a-9f64-4d9e-bacb-72121af1283a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:36.416354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7f99251a-9f64-4d9e-bacb-72121af1283a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:36.424547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f99251a-9f64-4d9e-bacb-72121af1283a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:36.425133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f99251a-9f64-4d9e-bacb-72121af1283a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:36.425932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f99251a-9f64-4d9e-bacb-72121af1283a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:36.426457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f99251a-9f64-4d9e-bacb-72121af1283a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:36.586656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7f99251a-9f64-4d9e-bacb-72121af1283a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:36.596213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7f99251a-9f64-4d9e-bacb-72121af1283a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.184031 Dec 15 16:30:36.596997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 559/1148] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:36 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:36.632315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bd30ee81-ee13-4d54-9d9c-8ee4d872fc3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:36.633208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bd30ee81-ee13-4d54-9d9c-8ee4d872fc3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:36.639759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd30ee81-ee13-4d54-9d9c-8ee4d872fc3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:36.640327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd30ee81-ee13-4d54-9d9c-8ee4d872fc3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:36.641206 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd30ee81-ee13-4d54-9d9c-8ee4d872fc3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:36.641628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd30ee81-ee13-4d54-9d9c-8ee4d872fc3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:36.672031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bd30ee81-ee13-4d54-9d9c-8ee4d872fc3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043469 Dec 15 16:30:36.672589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 590/1149] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:37.616954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e3d31c75-1ac5-425a-b328-c163d0780076 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:37.617587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e3d31c75-1ac5-425a-b328-c163d0780076 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:37.624696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3d31c75-1ac5-425a-b328-c163d0780076 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:37.625479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3d31c75-1ac5-425a-b328-c163d0780076 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:37.626316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3d31c75-1ac5-425a-b328-c163d0780076 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:37.626756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3d31c75-1ac5-425a-b328-c163d0780076 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:37.685195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3e6f6ad9-2339-48b3-9ea9-a1b15d537357 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:37.686849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3e6f6ad9-2339-48b3-9ea9-a1b15d537357 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:37.695688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e6f6ad9-2339-48b3-9ea9-a1b15d537357 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:37.696185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e6f6ad9-2339-48b3-9ea9-a1b15d537357 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:37.697258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e6f6ad9-2339-48b3-9ea9-a1b15d537357 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:37.698802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e6f6ad9-2339-48b3-9ea9-a1b15d537357 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:37.744073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3e6f6ad9-2339-48b3-9ea9-a1b15d537357 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064262 Dec 15 16:30:37.744687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 591/1150] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:37.769221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e3d31c75-1ac5-425a-b328-c163d0780076 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:37.780067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e3d31c75-1ac5-425a-b328-c163d0780076 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166581 Dec 15 16:30:37.780688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 560/1151] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:37 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:38.756831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7c942539-f30d-496b-b1f2-fd7f7cd0ea5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:38.757801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7c942539-f30d-496b-b1f2-fd7f7cd0ea5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:38.764614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c942539-f30d-496b-b1f2-fd7f7cd0ea5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:38.765086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c942539-f30d-496b-b1f2-fd7f7cd0ea5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:38.765993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c942539-f30d-496b-b1f2-fd7f7cd0ea5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:38.767216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c942539-f30d-496b-b1f2-fd7f7cd0ea5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:38.798476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-727771ad-d5fd-43ec-b6d0-16823ec71634 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:38.799071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7c942539-f30d-496b-b1f2-fd7f7cd0ea5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045917 Dec 15 16:30:38.799199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-727771ad-d5fd-43ec-b6d0-16823ec71634 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:38.799499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 592/1152] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:38.806252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-727771ad-d5fd-43ec-b6d0-16823ec71634 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:38.806696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-727771ad-d5fd-43ec-b6d0-16823ec71634 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:38.807486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-727771ad-d5fd-43ec-b6d0-16823ec71634 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:38.807912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-727771ad-d5fd-43ec-b6d0-16823ec71634 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:38.949684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-727771ad-d5fd-43ec-b6d0-16823ec71634 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:38.958289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-727771ad-d5fd-43ec-b6d0-16823ec71634 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.163545 Dec 15 16:30:38.958901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 561/1153] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:39.810596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a9580410-0031-48bd-b006-bc799b12fe4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:39.811493 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a9580410-0031-48bd-b006-bc799b12fe4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:39.818159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9580410-0031-48bd-b006-bc799b12fe4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:39.818607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9580410-0031-48bd-b006-bc799b12fe4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:39.819396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9580410-0031-48bd-b006-bc799b12fe4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:39.819825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9580410-0031-48bd-b006-bc799b12fe4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:39.850512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a9580410-0031-48bd-b006-bc799b12fe4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043693 Dec 15 16:30:39.851089 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 593/1154] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:39.977617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aadb48bb-4adf-4a7f-b70a-1252c0de5120 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:39.978198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aadb48bb-4adf-4a7f-b70a-1252c0de5120 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:39.987387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aadb48bb-4adf-4a7f-b70a-1252c0de5120 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:39.988088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aadb48bb-4adf-4a7f-b70a-1252c0de5120 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:39.989364 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aadb48bb-4adf-4a7f-b70a-1252c0de5120 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:39.990070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aadb48bb-4adf-4a7f-b70a-1252c0de5120 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:40.134583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aadb48bb-4adf-4a7f-b70a-1252c0de5120 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:40.142677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aadb48bb-4adf-4a7f-b70a-1252c0de5120 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169839 Dec 15 16:30:40.143265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 562/1155] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:40.862014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ce29b3b2-c82b-4ff4-bfd2-6099f57f8e2f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:40.862919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ce29b3b2-c82b-4ff4-bfd2-6099f57f8e2f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:40.872404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce29b3b2-c82b-4ff4-bfd2-6099f57f8e2f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:40.872952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce29b3b2-c82b-4ff4-bfd2-6099f57f8e2f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:40.874129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce29b3b2-c82b-4ff4-bfd2-6099f57f8e2f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:40.874856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce29b3b2-c82b-4ff4-bfd2-6099f57f8e2f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:40.914723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ce29b3b2-c82b-4ff4-bfd2-6099f57f8e2f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056519 Dec 15 16:30:40.915287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 594/1156] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:41.160544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e1aea169-01cd-4dfd-b691-54a8570a490d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:41.161204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e1aea169-01cd-4dfd-b691-54a8570a490d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:41.167854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1aea169-01cd-4dfd-b691-54a8570a490d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:41.168694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1aea169-01cd-4dfd-b691-54a8570a490d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:41.169540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1aea169-01cd-4dfd-b691-54a8570a490d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:41.169971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1aea169-01cd-4dfd-b691-54a8570a490d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:41.315770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1aea169-01cd-4dfd-b691-54a8570a490d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:41.323859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e1aea169-01cd-4dfd-b691-54a8570a490d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.167106 Dec 15 16:30:41.324451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 563/1157] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:41 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:41.927208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-afafb68a-c977-4db4-ba49-039961390a50 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:41.928019 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-afafb68a-c977-4db4-ba49-039961390a50 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:41.934706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afafb68a-c977-4db4-ba49-039961390a50 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:41.935134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afafb68a-c977-4db4-ba49-039961390a50 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:41.935935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afafb68a-c977-4db4-ba49-039961390a50 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:41.936371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afafb68a-c977-4db4-ba49-039961390a50 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:41.973135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-afafb68a-c977-4db4-ba49-039961390a50 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049797 Dec 15 16:30:41.973755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 595/1158] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:42.342245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-29eb5392-ec47-4aa6-9fcc-e631c8966b7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:42.344051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-29eb5392-ec47-4aa6-9fcc-e631c8966b7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:42.351036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-29eb5392-ec47-4aa6-9fcc-e631c8966b7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:42.351484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-29eb5392-ec47-4aa6-9fcc-e631c8966b7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:42.352285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-29eb5392-ec47-4aa6-9fcc-e631c8966b7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:42.352729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-29eb5392-ec47-4aa6-9fcc-e631c8966b7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:42.496802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-29eb5392-ec47-4aa6-9fcc-e631c8966b7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:42.505323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-29eb5392-ec47-4aa6-9fcc-e631c8966b7d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166786 Dec 15 16:30:42.505898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 564/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:42 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:42.984507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c4d8b613-3ead-4a2c-8e9f-b78abb7d6e93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:42.985434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c4d8b613-3ead-4a2c-8e9f-b78abb7d6e93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:42.992533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c4d8b613-3ead-4a2c-8e9f-b78abb7d6e93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:42.992989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c4d8b613-3ead-4a2c-8e9f-b78abb7d6e93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:42.993783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c4d8b613-3ead-4a2c-8e9f-b78abb7d6e93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:42.994219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c4d8b613-3ead-4a2c-8e9f-b78abb7d6e93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:43.026531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c4d8b613-3ead-4a2c-8e9f-b78abb7d6e93 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046019 Dec 15 16:30:43.027132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 596/1160] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:43.523017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3886deae-a95e-480c-a926-cb1371ea27cf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:43.523609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3886deae-a95e-480c-a926-cb1371ea27cf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:43.531038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3886deae-a95e-480c-a926-cb1371ea27cf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:43.531038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3886deae-a95e-480c-a926-cb1371ea27cf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:43.531881 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3886deae-a95e-480c-a926-cb1371ea27cf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:43.532552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3886deae-a95e-480c-a926-cb1371ea27cf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:43.679516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3886deae-a95e-480c-a926-cb1371ea27cf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:43.688393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3886deae-a95e-480c-a926-cb1371ea27cf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169272 Dec 15 16:30:43.689655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 565/1161] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:43 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:44.038588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-10d413e9-2a18-45a9-8f5e-4144fe3afdc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:44.039516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-10d413e9-2a18-45a9-8f5e-4144fe3afdc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:44.046462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10d413e9-2a18-45a9-8f5e-4144fe3afdc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:44.046887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10d413e9-2a18-45a9-8f5e-4144fe3afdc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:44.047703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10d413e9-2a18-45a9-8f5e-4144fe3afdc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:44.048131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10d413e9-2a18-45a9-8f5e-4144fe3afdc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:44.080083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-10d413e9-2a18-45a9-8f5e-4144fe3afdc0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045242 Dec 15 16:30:44.080682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 597/1162] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:44.708292 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8a2bba8b-372c-43ce-b248-f0c6733b5b0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:44.708940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8a2bba8b-372c-43ce-b248-f0c6733b5b0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:44.716223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a2bba8b-372c-43ce-b248-f0c6733b5b0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:44.716697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a2bba8b-372c-43ce-b248-f0c6733b5b0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:44.717828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a2bba8b-372c-43ce-b248-f0c6733b5b0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:44.718264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8a2bba8b-372c-43ce-b248-f0c6733b5b0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:44.860837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8a2bba8b-372c-43ce-b248-f0c6733b5b0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:44.868694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8a2bba8b-372c-43ce-b248-f0c6733b5b0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165507 Dec 15 16:30:44.869511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 566/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:45.091465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-53bfd7af-c84d-40a8-9c9d-fd9e07aba602 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:45.092381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-53bfd7af-c84d-40a8-9c9d-fd9e07aba602 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:45.099658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53bfd7af-c84d-40a8-9c9d-fd9e07aba602 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:45.100106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53bfd7af-c84d-40a8-9c9d-fd9e07aba602 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:45.100968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53bfd7af-c84d-40a8-9c9d-fd9e07aba602 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:45.101385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53bfd7af-c84d-40a8-9c9d-fd9e07aba602 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:45.134548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-53bfd7af-c84d-40a8-9c9d-fd9e07aba602 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046851 Dec 15 16:30:45.135163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 598/1164] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:45.886085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f5179235-5fcd-420c-9d16-f69e6e6896e5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:45.887534 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f5179235-5fcd-420c-9d16-f69e6e6896e5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:45.895178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f5179235-5fcd-420c-9d16-f69e6e6896e5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:45.895626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f5179235-5fcd-420c-9d16-f69e6e6896e5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:45.896463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f5179235-5fcd-420c-9d16-f69e6e6896e5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:45.896945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f5179235-5fcd-420c-9d16-f69e6e6896e5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:46.033778 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f5179235-5fcd-420c-9d16-f69e6e6896e5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:46.042476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f5179235-5fcd-420c-9d16-f69e6e6896e5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.160179 Dec 15 16:30:46.043058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 567/1165] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:46.148184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-63a0f650-1cc1-448c-883b-a7cdd2e0fbcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:46.149059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-63a0f650-1cc1-448c-883b-a7cdd2e0fbcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:46.156908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63a0f650-1cc1-448c-883b-a7cdd2e0fbcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:46.157376 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63a0f650-1cc1-448c-883b-a7cdd2e0fbcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:46.158192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63a0f650-1cc1-448c-883b-a7cdd2e0fbcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:46.158630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63a0f650-1cc1-448c-883b-a7cdd2e0fbcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:46.192832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-63a0f650-1cc1-448c-883b-a7cdd2e0fbcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048781 Dec 15 16:30:46.193419 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 599/1166] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:47.060108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9f89a0ba-bd84-4ca7-96ba-30448773e863 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:47.060900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9f89a0ba-bd84-4ca7-96ba-30448773e863 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:47.067840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f89a0ba-bd84-4ca7-96ba-30448773e863 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:47.068519 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f89a0ba-bd84-4ca7-96ba-30448773e863 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:47.069349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f89a0ba-bd84-4ca7-96ba-30448773e863 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:47.069772 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f89a0ba-bd84-4ca7-96ba-30448773e863 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:47.204989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3cb7bf99-ab32-476a-b35e-ddc5ee0f2288 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:47.209116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3cb7bf99-ab32-476a-b35e-ddc5ee0f2288 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:47.217657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cb7bf99-ab32-476a-b35e-ddc5ee0f2288 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:47.218229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cb7bf99-ab32-476a-b35e-ddc5ee0f2288 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:47.219423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cb7bf99-ab32-476a-b35e-ddc5ee0f2288 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:47.219866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cb7bf99-ab32-476a-b35e-ddc5ee0f2288 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:47.252541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3cb7bf99-ab32-476a-b35e-ddc5ee0f2288 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051800 Dec 15 16:30:47.253505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 600/1167] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:30:47.264598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9f89a0ba-bd84-4ca7-96ba-30448773e863 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:47.272766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9f89a0ba-bd84-4ca7-96ba-30448773e863 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.216554 Dec 15 16:30:47.273338 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 568/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:48.264408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-66a970e5-e987-494e-a664-2b9cba77615a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:48.265226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-66a970e5-e987-494e-a664-2b9cba77615a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:48.272364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66a970e5-e987-494e-a664-2b9cba77615a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:48.272848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66a970e5-e987-494e-a664-2b9cba77615a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:48.273653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66a970e5-e987-494e-a664-2b9cba77615a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:48.274089 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66a970e5-e987-494e-a664-2b9cba77615a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:48.290463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-64364136-5ccd-4393-ad2a-3c441d44c9e2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:48.291069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-64364136-5ccd-4393-ad2a-3c441d44c9e2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:48.298167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64364136-5ccd-4393-ad2a-3c441d44c9e2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:48.298805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64364136-5ccd-4393-ad2a-3c441d44c9e2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:48.299600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64364136-5ccd-4393-ad2a-3c441d44c9e2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:48.300049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64364136-5ccd-4393-ad2a-3c441d44c9e2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:48.310298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-66a970e5-e987-494e-a664-2b9cba77615a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049949 Dec 15 16:30:48.311106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 601/1169] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:48 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:48.449174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-64364136-5ccd-4393-ad2a-3c441d44c9e2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:48.457671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-64364136-5ccd-4393-ad2a-3c441d44c9e2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170916 Dec 15 16:30:48.458256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 569/1170] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:49.322758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b6dee8ff-1954-456b-88a9-ad4596c332fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:49.323710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b6dee8ff-1954-456b-88a9-ad4596c332fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:49.331402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6dee8ff-1954-456b-88a9-ad4596c332fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:49.331971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6dee8ff-1954-456b-88a9-ad4596c332fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:49.332988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6dee8ff-1954-456b-88a9-ad4596c332fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:49.333424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6dee8ff-1954-456b-88a9-ad4596c332fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:49.365331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b6dee8ff-1954-456b-88a9-ad4596c332fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046406 Dec 15 16:30:49.366032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 602/1171] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:49.475896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-22445b2c-e72a-430c-bea7-1d6166bdcfd8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:49.476554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-22445b2c-e72a-430c-bea7-1d6166bdcfd8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:49.483398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-22445b2c-e72a-430c-bea7-1d6166bdcfd8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:49.483850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-22445b2c-e72a-430c-bea7-1d6166bdcfd8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:49.484847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-22445b2c-e72a-430c-bea7-1d6166bdcfd8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:49.485295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-22445b2c-e72a-430c-bea7-1d6166bdcfd8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:49.650845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-22445b2c-e72a-430c-bea7-1d6166bdcfd8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:49.659223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-22445b2c-e72a-430c-bea7-1d6166bdcfd8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.187182 Dec 15 16:30:49.659788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 570/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:49 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:50.379935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-73860921-6f77-46ed-9259-b2d344bd3830 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:50.381410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-73860921-6f77-46ed-9259-b2d344bd3830 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:50.390403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73860921-6f77-46ed-9259-b2d344bd3830 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:50.390896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73860921-6f77-46ed-9259-b2d344bd3830 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:50.392201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73860921-6f77-46ed-9259-b2d344bd3830 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:50.392669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73860921-6f77-46ed-9259-b2d344bd3830 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:50.429311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-73860921-6f77-46ed-9259-b2d344bd3830 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055212 Dec 15 16:30:50.433408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 603/1173] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:50.580820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:30:50.581107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:30:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:30:50.678077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c0aba9f5-8faf-4349-a215-dc739aa26b9d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:50.678684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c0aba9f5-8faf-4349-a215-dc739aa26b9d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:50.685502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c0aba9f5-8faf-4349-a215-dc739aa26b9d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:50.685951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c0aba9f5-8faf-4349-a215-dc739aa26b9d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:50.686754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c0aba9f5-8faf-4349-a215-dc739aa26b9d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:50.687190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c0aba9f5-8faf-4349-a215-dc739aa26b9d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:50.847377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c0aba9f5-8faf-4349-a215-dc739aa26b9d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:50.855407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c0aba9f5-8faf-4349-a215-dc739aa26b9d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.181213 Dec 15 16:30:50.856034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 571/1174] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:50 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:51.442175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6fca19c5-1b83-4e38-9064-39ff71a0dc61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:51.443102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6fca19c5-1b83-4e38-9064-39ff71a0dc61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:51.450198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fca19c5-1b83-4e38-9064-39ff71a0dc61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:51.450638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fca19c5-1b83-4e38-9064-39ff71a0dc61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:51.451444 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fca19c5-1b83-4e38-9064-39ff71a0dc61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:51.451879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fca19c5-1b83-4e38-9064-39ff71a0dc61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:51.486509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6fca19c5-1b83-4e38-9064-39ff71a0dc61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048952 Dec 15 16:30:51.487115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 604/1175] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:51.874296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8b930e75-1299-46a2-892f-a08f065e8d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:51.875262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8b930e75-1299-46a2-892f-a08f065e8d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:51.881983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b930e75-1299-46a2-892f-a08f065e8d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:51.882430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b930e75-1299-46a2-892f-a08f065e8d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:51.883238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b930e75-1299-46a2-892f-a08f065e8d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:51.883667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b930e75-1299-46a2-892f-a08f065e8d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:52.059265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8b930e75-1299-46a2-892f-a08f065e8d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:52.067881 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8b930e75-1299-46a2-892f-a08f065e8d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.197302 Dec 15 16:30:52.068505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 572/1176] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:52.499079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3274ffc6-85f2-4e28-82a1-287425b6886b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:52.500017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3274ffc6-85f2-4e28-82a1-287425b6886b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:52.507280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3274ffc6-85f2-4e28-82a1-287425b6886b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:52.507723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3274ffc6-85f2-4e28-82a1-287425b6886b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:52.508554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3274ffc6-85f2-4e28-82a1-287425b6886b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:52.508989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3274ffc6-85f2-4e28-82a1-287425b6886b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:52.542265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3274ffc6-85f2-4e28-82a1-287425b6886b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046870 Dec 15 16:30:52.542835 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 605/1177] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:53.089631 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bb67d0f5-fd48-4ceb-804e-d14235c7506f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:53.090251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bb67d0f5-fd48-4ceb-804e-d14235c7506f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:53.097915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bb67d0f5-fd48-4ceb-804e-d14235c7506f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:53.098359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bb67d0f5-fd48-4ceb-804e-d14235c7506f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:53.099165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bb67d0f5-fd48-4ceb-804e-d14235c7506f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:53.099599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bb67d0f5-fd48-4ceb-804e-d14235c7506f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:53.258924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bb67d0f5-fd48-4ceb-804e-d14235c7506f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:53.267750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bb67d0f5-fd48-4ceb-804e-d14235c7506f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.181909 Dec 15 16:30:53.268354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 573/1178] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:53 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:53.555832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-47af199d-e808-4170-8474-300b45899f7f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:53.556700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-47af199d-e808-4170-8474-300b45899f7f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:53.563883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47af199d-e808-4170-8474-300b45899f7f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:53.564325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47af199d-e808-4170-8474-300b45899f7f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:53.565252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47af199d-e808-4170-8474-300b45899f7f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:53.565601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47af199d-e808-4170-8474-300b45899f7f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:53.599572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-47af199d-e808-4170-8474-300b45899f7f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048382 Dec 15 16:30:53.600137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 606/1179] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:54.286811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4fef7594-45be-4e22-8839-839b79bfdcb9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:54.287633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4fef7594-45be-4e22-8839-839b79bfdcb9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:54.294331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4fef7594-45be-4e22-8839-839b79bfdcb9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:54.294797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4fef7594-45be-4e22-8839-839b79bfdcb9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:54.295596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4fef7594-45be-4e22-8839-839b79bfdcb9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:54.296025 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4fef7594-45be-4e22-8839-839b79bfdcb9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:54.457230 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4fef7594-45be-4e22-8839-839b79bfdcb9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:54.467237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4fef7594-45be-4e22-8839-839b79bfdcb9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.184359 Dec 15 16:30:54.467831 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 574/1180] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:54 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:54.611620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-23b02247-a412-450a-9024-3f1cf3220b3e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:54.612643 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-23b02247-a412-450a-9024-3f1cf3220b3e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:54.620595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23b02247-a412-450a-9024-3f1cf3220b3e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:54.621065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23b02247-a412-450a-9024-3f1cf3220b3e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:54.621839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23b02247-a412-450a-9024-3f1cf3220b3e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:54.622279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23b02247-a412-450a-9024-3f1cf3220b3e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:54.654866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-23b02247-a412-450a-9024-3f1cf3220b3e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047065 Dec 15 16:30:54.655327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 607/1181] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:55.486430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d62b4986-e4fc-422d-a271-04502f198427 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:55.487070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d62b4986-e4fc-422d-a271-04502f198427 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:55.494482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d62b4986-e4fc-422d-a271-04502f198427 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:55.494924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d62b4986-e4fc-422d-a271-04502f198427 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:55.495729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d62b4986-e4fc-422d-a271-04502f198427 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:55.496160 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d62b4986-e4fc-422d-a271-04502f198427 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:55.651746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d62b4986-e4fc-422d-a271-04502f198427 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:55.661656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d62b4986-e4fc-422d-a271-04502f198427 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.179663 Dec 15 16:30:55.662214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 575/1182] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:55.667949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-01260fba-342a-45ff-94e0-78b61970809d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:55.669037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-01260fba-342a-45ff-94e0-78b61970809d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:55.675864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-01260fba-342a-45ff-94e0-78b61970809d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:55.676314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-01260fba-342a-45ff-94e0-78b61970809d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:55.677147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-01260fba-342a-45ff-94e0-78b61970809d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:55.677617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-01260fba-342a-45ff-94e0-78b61970809d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:55.711080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-01260fba-342a-45ff-94e0-78b61970809d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046840 Dec 15 16:30:55.711673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 608/1183] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:56.680475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3e61cc36-5081-4232-8b1a-bacb36920f81 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:56.681206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3e61cc36-5081-4232-8b1a-bacb36920f81 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:56.688913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3e61cc36-5081-4232-8b1a-bacb36920f81 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:56.689363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3e61cc36-5081-4232-8b1a-bacb36920f81 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:56.690194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3e61cc36-5081-4232-8b1a-bacb36920f81 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:56.690678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3e61cc36-5081-4232-8b1a-bacb36920f81 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:56.723810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9735250a-d2fd-4f5f-ba8f-63fc9ba75ea9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:56.724747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9735250a-d2fd-4f5f-ba8f-63fc9ba75ea9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:56.731750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9735250a-d2fd-4f5f-ba8f-63fc9ba75ea9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:56.732162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9735250a-d2fd-4f5f-ba8f-63fc9ba75ea9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:56.733630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9735250a-d2fd-4f5f-ba8f-63fc9ba75ea9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:56.733857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9735250a-d2fd-4f5f-ba8f-63fc9ba75ea9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:56.766546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9735250a-d2fd-4f5f-ba8f-63fc9ba75ea9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046740 Dec 15 16:30:56.767126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 609/1184] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:30:56.860084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3e61cc36-5081-4232-8b1a-bacb36920f81 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:56.869050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3e61cc36-5081-4232-8b1a-bacb36920f81 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.192447 Dec 15 16:30:56.869654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 576/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:57.840319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0e23789a-4cab-42de-84f8-c9e149982984 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:57.841354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0e23789a-4cab-42de-84f8-c9e149982984 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:57.847977 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e23789a-4cab-42de-84f8-c9e149982984 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:57.848424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e23789a-4cab-42de-84f8-c9e149982984 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:57.849236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e23789a-4cab-42de-84f8-c9e149982984 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:57.849664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e23789a-4cab-42de-84f8-c9e149982984 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:57.881346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0e23789a-4cab-42de-84f8-c9e149982984 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106039 Dec 15 16:30:57.882024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 610/1186] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:57.889988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b94062be-ef30-4f52-9272-1a64f0de61c1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:57.890792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b94062be-ef30-4f52-9272-1a64f0de61c1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:57.900249 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b94062be-ef30-4f52-9272-1a64f0de61c1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:57.901042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b94062be-ef30-4f52-9272-1a64f0de61c1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:57.902398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b94062be-ef30-4f52-9272-1a64f0de61c1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:57.903159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b94062be-ef30-4f52-9272-1a64f0de61c1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:58.059329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b94062be-ef30-4f52-9272-1a64f0de61c1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:58.067672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b94062be-ef30-4f52-9272-1a64f0de61c1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.183856 Dec 15 16:30:58.068265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 577/1187] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:58.827586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:30:58.827953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:30:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:30:58.894562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e86fb3c6-63fe-45e4-b6b4-6bb989cdb085 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:58.895502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e86fb3c6-63fe-45e4-b6b4-6bb989cdb085 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:58.902741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e86fb3c6-63fe-45e4-b6b4-6bb989cdb085 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:58.903204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e86fb3c6-63fe-45e4-b6b4-6bb989cdb085 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:58.904027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e86fb3c6-63fe-45e4-b6b4-6bb989cdb085 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:58.904495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e86fb3c6-63fe-45e4-b6b4-6bb989cdb085 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:58.939216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e86fb3c6-63fe-45e4-b6b4-6bb989cdb085 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048831 Dec 15 16:30:58.939827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 611/1188] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:30:59.086810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c99a491b-1d36-4891-a3eb-8ed680a0ff93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:59.087437 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c99a491b-1d36-4891-a3eb-8ed680a0ff93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:59.094959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c99a491b-1d36-4891-a3eb-8ed680a0ff93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:59.095409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c99a491b-1d36-4891-a3eb-8ed680a0ff93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:59.096218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c99a491b-1d36-4891-a3eb-8ed680a0ff93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:59.096694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c99a491b-1d36-4891-a3eb-8ed680a0ff93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:59.256221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c99a491b-1d36-4891-a3eb-8ed680a0ff93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:59.264897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c99a491b-1d36-4891-a3eb-8ed680a0ff93 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.182822 Dec 15 16:30:59.265615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 578/1189] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:30:59 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:59.954097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1ceb2f89-c843-41e2-b729-c3096431f836 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:59.955576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1ceb2f89-c843-41e2-b729-c3096431f836 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:59.966173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ceb2f89-c843-41e2-b729-c3096431f836 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:59.966706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ceb2f89-c843-41e2-b729-c3096431f836 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:59.968076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ceb2f89-c843-41e2-b729-c3096431f836 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:59.968902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ceb2f89-c843-41e2-b729-c3096431f836 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:00.023006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1ceb2f89-c843-41e2-b729-c3096431f836 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075036 Dec 15 16:31:00.023704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 612/1190] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:00.283587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1e37063e-2f32-4878-aece-f1b503ef6534 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:00.284177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1e37063e-2f32-4878-aece-f1b503ef6534 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:00.290759 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e37063e-2f32-4878-aece-f1b503ef6534 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:00.291198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e37063e-2f32-4878-aece-f1b503ef6534 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:00.292015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e37063e-2f32-4878-aece-f1b503ef6534 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:00.292464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e37063e-2f32-4878-aece-f1b503ef6534 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:00.455561 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1e37063e-2f32-4878-aece-f1b503ef6534 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:00.463699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1e37063e-2f32-4878-aece-f1b503ef6534 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.184140 Dec 15 16:31:00.464298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 579/1191] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:01.037684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4e4aaa5b-8353-44f2-be15-9f9853cf9dfa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:01.038614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4e4aaa5b-8353-44f2-be15-9f9853cf9dfa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:01.045645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e4aaa5b-8353-44f2-be15-9f9853cf9dfa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:01.046203 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e4aaa5b-8353-44f2-be15-9f9853cf9dfa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:01.047021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e4aaa5b-8353-44f2-be15-9f9853cf9dfa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:01.047449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e4aaa5b-8353-44f2-be15-9f9853cf9dfa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:01.081011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4e4aaa5b-8353-44f2-be15-9f9853cf9dfa tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046960 Dec 15 16:31:01.081566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 613/1192] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:01.481885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c51ab49e-3fe2-4fa2-a174-25520b815a9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:01.482645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c51ab49e-3fe2-4fa2-a174-25520b815a9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:01.490410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c51ab49e-3fe2-4fa2-a174-25520b815a9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:01.490867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c51ab49e-3fe2-4fa2-a174-25520b815a9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:01.491696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c51ab49e-3fe2-4fa2-a174-25520b815a9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:01.492502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c51ab49e-3fe2-4fa2-a174-25520b815a9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:01.642502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c51ab49e-3fe2-4fa2-a174-25520b815a9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:01.651035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c51ab49e-3fe2-4fa2-a174-25520b815a9f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173185 Dec 15 16:31:01.651633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 580/1193] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:02.097031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-26d6243b-d873-44cc-82b8-6d5d82679408 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:02.098016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-26d6243b-d873-44cc-82b8-6d5d82679408 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:02.105075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26d6243b-d873-44cc-82b8-6d5d82679408 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:02.105526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26d6243b-d873-44cc-82b8-6d5d82679408 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:02.106347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26d6243b-d873-44cc-82b8-6d5d82679408 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:02.106782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26d6243b-d873-44cc-82b8-6d5d82679408 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:02.146907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-26d6243b-d873-44cc-82b8-6d5d82679408 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057095 Dec 15 16:31:02.147479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 614/1194] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:02.672576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bffb28d5-5458-4703-8cb5-db953de804c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:02.673570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bffb28d5-5458-4703-8cb5-db953de804c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:02.685142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bffb28d5-5458-4703-8cb5-db953de804c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:02.686063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bffb28d5-5458-4703-8cb5-db953de804c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:02.687692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bffb28d5-5458-4703-8cb5-db953de804c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:02.688044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bffb28d5-5458-4703-8cb5-db953de804c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:02.840172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bffb28d5-5458-4703-8cb5-db953de804c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:02.849796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bffb28d5-5458-4703-8cb5-db953de804c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.184250 Dec 15 16:31:02.850381 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 581/1195] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:03.158734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6897e0d3-4eaf-4a69-9f16-a80ce9a8ab7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:03.159649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6897e0d3-4eaf-4a69-9f16-a80ce9a8ab7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:03.166443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6897e0d3-4eaf-4a69-9f16-a80ce9a8ab7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:03.166894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6897e0d3-4eaf-4a69-9f16-a80ce9a8ab7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:03.167699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6897e0d3-4eaf-4a69-9f16-a80ce9a8ab7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:03.168142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6897e0d3-4eaf-4a69-9f16-a80ce9a8ab7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:03.201481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6897e0d3-4eaf-4a69-9f16-a80ce9a8ab7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046745 Dec 15 16:31:03.202588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 615/1196] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:03.868760 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fa902e3d-17a2-4f13-b0c4-415e1b7fcea9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:03.869413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fa902e3d-17a2-4f13-b0c4-415e1b7fcea9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:03.878869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa902e3d-17a2-4f13-b0c4-415e1b7fcea9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:03.879309 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa902e3d-17a2-4f13-b0c4-415e1b7fcea9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:03.880125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa902e3d-17a2-4f13-b0c4-415e1b7fcea9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:03.880583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa902e3d-17a2-4f13-b0c4-415e1b7fcea9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:04.035581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fa902e3d-17a2-4f13-b0c4-415e1b7fcea9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:04.046005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fa902e3d-17a2-4f13-b0c4-415e1b7fcea9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.180688 Dec 15 16:31:04.046827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 582/1197] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:03 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:04.214054 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-89520073-7b79-4392-adac-f56527627899 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:04.214973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-89520073-7b79-4392-adac-f56527627899 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:04.222065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-89520073-7b79-4392-adac-f56527627899 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:04.222426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-89520073-7b79-4392-adac-f56527627899 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:04.223219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-89520073-7b79-4392-adac-f56527627899 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:04.223622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-89520073-7b79-4392-adac-f56527627899 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:04.258648 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-89520073-7b79-4392-adac-f56527627899 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048352 Dec 15 16:31:04.259234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 616/1198] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:05.073803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9ac93694-2df0-4b6f-a46c-a525be8bfff5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:05.074837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9ac93694-2df0-4b6f-a46c-a525be8bfff5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:05.085624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ac93694-2df0-4b6f-a46c-a525be8bfff5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:05.086343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ac93694-2df0-4b6f-a46c-a525be8bfff5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:05.087632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ac93694-2df0-4b6f-a46c-a525be8bfff5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:05.088371 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ac93694-2df0-4b6f-a46c-a525be8bfff5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:05.257668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9ac93694-2df0-4b6f-a46c-a525be8bfff5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:05.266685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9ac93694-2df0-4b6f-a46c-a525be8bfff5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.199282 Dec 15 16:31:05.267666 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 583/1199] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:05.274295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-db9b917d-ed7a-467b-91b7-31dd0e05baa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:05.275901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-db9b917d-ed7a-467b-91b7-31dd0e05baa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:05.287075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-db9b917d-ed7a-467b-91b7-31dd0e05baa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:05.287855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-db9b917d-ed7a-467b-91b7-31dd0e05baa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:05.289064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-db9b917d-ed7a-467b-91b7-31dd0e05baa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:05.289717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-db9b917d-ed7a-467b-91b7-31dd0e05baa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:05.328289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-db9b917d-ed7a-467b-91b7-31dd0e05baa7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060650 Dec 15 16:31:05.328815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 617/1200] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:31:06.284755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6ba0cc0f-ecb1-4fc7-9ee6-d5a969896687 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:06.285391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6ba0cc0f-ecb1-4fc7-9ee6-d5a969896687 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:06.292309 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6ba0cc0f-ecb1-4fc7-9ee6-d5a969896687 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:06.292943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6ba0cc0f-ecb1-4fc7-9ee6-d5a969896687 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:06.293765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6ba0cc0f-ecb1-4fc7-9ee6-d5a969896687 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:06.294301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6ba0cc0f-ecb1-4fc7-9ee6-d5a969896687 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:06.340893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d11b3c1c-2721-4e6a-8d18-285cc7bfdc23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:06.342300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d11b3c1c-2721-4e6a-8d18-285cc7bfdc23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:06.349480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d11b3c1c-2721-4e6a-8d18-285cc7bfdc23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:06.349919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d11b3c1c-2721-4e6a-8d18-285cc7bfdc23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:06.350713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d11b3c1c-2721-4e6a-8d18-285cc7bfdc23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:06.351147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d11b3c1c-2721-4e6a-8d18-285cc7bfdc23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:06.406758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d11b3c1c-2721-4e6a-8d18-285cc7bfdc23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069633 Dec 15 16:31:06.407706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 618/1201] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:06.458489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6ba0cc0f-ecb1-4fc7-9ee6-d5a969896687 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:06.467198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6ba0cc0f-ecb1-4fc7-9ee6-d5a969896687 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.186066 Dec 15 16:31:06.467808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 584/1202] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:07.421520 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-410f4c26-0a0d-4ad4-9564-5dc28664d943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:07.422402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-410f4c26-0a0d-4ad4-9564-5dc28664d943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:07.428993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-410f4c26-0a0d-4ad4-9564-5dc28664d943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:07.429445 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-410f4c26-0a0d-4ad4-9564-5dc28664d943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:07.430249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-410f4c26-0a0d-4ad4-9564-5dc28664d943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:07.430676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-410f4c26-0a0d-4ad4-9564-5dc28664d943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:07.473063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-410f4c26-0a0d-4ad4-9564-5dc28664d943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055696 Dec 15 16:31:07.473684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 619/1203] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:07.484988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-af7e2886-dbe3-4dfe-baac-3b8f8e8a01d3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:07.485607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-af7e2886-dbe3-4dfe-baac-3b8f8e8a01d3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:07.495793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af7e2886-dbe3-4dfe-baac-3b8f8e8a01d3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:07.496411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af7e2886-dbe3-4dfe-baac-3b8f8e8a01d3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:07.497575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af7e2886-dbe3-4dfe-baac-3b8f8e8a01d3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:07.498088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-af7e2886-dbe3-4dfe-baac-3b8f8e8a01d3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:07.647716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-af7e2886-dbe3-4dfe-baac-3b8f8e8a01d3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:07.657180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-af7e2886-dbe3-4dfe-baac-3b8f8e8a01d3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176244 Dec 15 16:31:07.657753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 585/1204] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:07 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:08.486076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aab881b4-09d4-4691-84c4-50bef790ebcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:08.486979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aab881b4-09d4-4691-84c4-50bef790ebcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:08.494064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aab881b4-09d4-4691-84c4-50bef790ebcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:08.494511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aab881b4-09d4-4691-84c4-50bef790ebcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:08.495308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aab881b4-09d4-4691-84c4-50bef790ebcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:08.495743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aab881b4-09d4-4691-84c4-50bef790ebcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:08.527290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aab881b4-09d4-4691-84c4-50bef790ebcc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045649 Dec 15 16:31:08.527837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 620/1205] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:08.677665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3606d4d7-7a82-4321-87bb-73080219c1f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:08.678811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3606d4d7-7a82-4321-87bb-73080219c1f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:08.689111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3606d4d7-7a82-4321-87bb-73080219c1f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:08.689892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3606d4d7-7a82-4321-87bb-73080219c1f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:08.691247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3606d4d7-7a82-4321-87bb-73080219c1f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:08.691993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3606d4d7-7a82-4321-87bb-73080219c1f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:08.831162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3606d4d7-7a82-4321-87bb-73080219c1f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:08.839089 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3606d4d7-7a82-4321-87bb-73080219c1f3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.167712 Dec 15 16:31:08.839781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 586/1206] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:09.541481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-48a608cd-43c8-4431-93f0-725792d91ef0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:09.542303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-48a608cd-43c8-4431-93f0-725792d91ef0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:09.549548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-48a608cd-43c8-4431-93f0-725792d91ef0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:09.549970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-48a608cd-43c8-4431-93f0-725792d91ef0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:09.550754 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-48a608cd-43c8-4431-93f0-725792d91ef0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:09.551216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-48a608cd-43c8-4431-93f0-725792d91ef0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:09.588541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-48a608cd-43c8-4431-93f0-725792d91ef0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050949 Dec 15 16:31:09.589103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 621/1207] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:09.857355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c3c9492b-f461-427d-83eb-db23685dcad4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:09.857990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c3c9492b-f461-427d-83eb-db23685dcad4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:09.865233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3c9492b-f461-427d-83eb-db23685dcad4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:09.865672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3c9492b-f461-427d-83eb-db23685dcad4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:09.866923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3c9492b-f461-427d-83eb-db23685dcad4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:09.867364 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3c9492b-f461-427d-83eb-db23685dcad4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:10.010655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c3c9492b-f461-427d-83eb-db23685dcad4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:10.020074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c3c9492b-f461-427d-83eb-db23685dcad4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166564 Dec 15 16:31:10.020688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 587/1208] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:10.602143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c2456ff1-824d-4f06-8e2b-d8751ee2520d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:10.603040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c2456ff1-824d-4f06-8e2b-d8751ee2520d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:10.610764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2456ff1-824d-4f06-8e2b-d8751ee2520d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:10.611250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2456ff1-824d-4f06-8e2b-d8751ee2520d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:10.612044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2456ff1-824d-4f06-8e2b-d8751ee2520d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:10.612489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2456ff1-824d-4f06-8e2b-d8751ee2520d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:10.646354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c2456ff1-824d-4f06-8e2b-d8751ee2520d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048534 Dec 15 16:31:10.647124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 622/1209] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:11.037885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-294e5ba5-78d8-41fe-9ba8-75246adaf1aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:11.038486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-294e5ba5-78d8-41fe-9ba8-75246adaf1aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:11.045507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-294e5ba5-78d8-41fe-9ba8-75246adaf1aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:11.045951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-294e5ba5-78d8-41fe-9ba8-75246adaf1aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:11.046743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-294e5ba5-78d8-41fe-9ba8-75246adaf1aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:11.047205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-294e5ba5-78d8-41fe-9ba8-75246adaf1aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:11.199953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-294e5ba5-78d8-41fe-9ba8-75246adaf1aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:11.208941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-294e5ba5-78d8-41fe-9ba8-75246adaf1aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174882 Dec 15 16:31:11.209523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 588/1210] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:11 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:11.658894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6334dd47-96d5-4be5-8962-57d7295c3771 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:11.659791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6334dd47-96d5-4be5-8962-57d7295c3771 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:11.667765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6334dd47-96d5-4be5-8962-57d7295c3771 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:11.668215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6334dd47-96d5-4be5-8962-57d7295c3771 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:11.669145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6334dd47-96d5-4be5-8962-57d7295c3771 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:11.669580 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6334dd47-96d5-4be5-8962-57d7295c3771 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:11.704367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6334dd47-96d5-4be5-8962-57d7295c3771 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049205 Dec 15 16:31:11.705043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 623/1211] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:12.227634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-692d74f7-3094-4296-a0aa-8503eb4af329 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:12.228492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-692d74f7-3094-4296-a0aa-8503eb4af329 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:12.236727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-692d74f7-3094-4296-a0aa-8503eb4af329 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:12.237172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-692d74f7-3094-4296-a0aa-8503eb4af329 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:12.237958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-692d74f7-3094-4296-a0aa-8503eb4af329 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:12.238382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-692d74f7-3094-4296-a0aa-8503eb4af329 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:12.388467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-692d74f7-3094-4296-a0aa-8503eb4af329 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:12.396942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-692d74f7-3094-4296-a0aa-8503eb4af329 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174091 Dec 15 16:31:12.397785 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 589/1212] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:12 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:12.717896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-526d4472-53ed-46ec-8090-9ac2381cafd6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:12.718747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-526d4472-53ed-46ec-8090-9ac2381cafd6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:12.725872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-526d4472-53ed-46ec-8090-9ac2381cafd6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:12.726328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-526d4472-53ed-46ec-8090-9ac2381cafd6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:12.727143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-526d4472-53ed-46ec-8090-9ac2381cafd6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:12.727572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-526d4472-53ed-46ec-8090-9ac2381cafd6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:12.761859 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-526d4472-53ed-46ec-8090-9ac2381cafd6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049236 Dec 15 16:31:12.764349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 624/1213] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:13.417271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7c2c9bdc-151e-4c38-b3ad-34e7beaba57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:13.418112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7c2c9bdc-151e-4c38-b3ad-34e7beaba57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:13.424988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c2c9bdc-151e-4c38-b3ad-34e7beaba57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:13.425456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c2c9bdc-151e-4c38-b3ad-34e7beaba57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:13.426270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c2c9bdc-151e-4c38-b3ad-34e7beaba57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:13.426681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c2c9bdc-151e-4c38-b3ad-34e7beaba57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:13.598800 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7c2c9bdc-151e-4c38-b3ad-34e7beaba57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:13.608126 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7c2c9bdc-151e-4c38-b3ad-34e7beaba57c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.196468 Dec 15 16:31:13.608820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 590/1214] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:13.778244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-75588d81-024a-456b-847b-5c05152a82a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:13.779196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-75588d81-024a-456b-847b-5c05152a82a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:13.785766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75588d81-024a-456b-847b-5c05152a82a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:13.786215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75588d81-024a-456b-847b-5c05152a82a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:13.787013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75588d81-024a-456b-847b-5c05152a82a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:13.787442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75588d81-024a-456b-847b-5c05152a82a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:13.820537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-75588d81-024a-456b-847b-5c05152a82a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048481 Dec 15 16:31:13.821106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 625/1215] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:14.626857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-74db719a-1776-4687-8f50-f93e7169a1b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:14.627502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-74db719a-1776-4687-8f50-f93e7169a1b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:14.634317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-74db719a-1776-4687-8f50-f93e7169a1b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:14.634762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-74db719a-1776-4687-8f50-f93e7169a1b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:14.635541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-74db719a-1776-4687-8f50-f93e7169a1b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:14.635968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-74db719a-1776-4687-8f50-f93e7169a1b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:14.785971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-74db719a-1776-4687-8f50-f93e7169a1b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:14.794289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-74db719a-1776-4687-8f50-f93e7169a1b3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171245 Dec 15 16:31:14.795023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 591/1216] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:14.833866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b127aa1e-c10b-407c-b673-49e1afd2b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:14.834780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b127aa1e-c10b-407c-b673-49e1afd2b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:14.841673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b127aa1e-c10b-407c-b673-49e1afd2b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:14.842180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b127aa1e-c10b-407c-b673-49e1afd2b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:14.843010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b127aa1e-c10b-407c-b673-49e1afd2b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:14.843437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b127aa1e-c10b-407c-b673-49e1afd2b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:14.876017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b127aa1e-c10b-407c-b673-49e1afd2b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046063 Dec 15 16:31:14.876617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 626/1217] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:15.813600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2b46d0d9-99d6-4d7a-9e0b-b7742e3810bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:15.814189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2b46d0d9-99d6-4d7a-9e0b-b7742e3810bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:15.821013 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b46d0d9-99d6-4d7a-9e0b-b7742e3810bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:15.821482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b46d0d9-99d6-4d7a-9e0b-b7742e3810bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:15.822256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b46d0d9-99d6-4d7a-9e0b-b7742e3810bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:15.822679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b46d0d9-99d6-4d7a-9e0b-b7742e3810bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:15.887636 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f24cbdc2-763e-4ffb-827c-16a158a2baad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:15.888640 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f24cbdc2-763e-4ffb-827c-16a158a2baad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:15.896197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f24cbdc2-763e-4ffb-827c-16a158a2baad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:15.897017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f24cbdc2-763e-4ffb-827c-16a158a2baad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:15.897817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f24cbdc2-763e-4ffb-827c-16a158a2baad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:15.898322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f24cbdc2-763e-4ffb-827c-16a158a2baad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:15.931145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f24cbdc2-763e-4ffb-827c-16a158a2baad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047453 Dec 15 16:31:15.932076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 627/1218] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:15.987403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2b46d0d9-99d6-4d7a-9e0b-b7742e3810bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:15.996048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2b46d0d9-99d6-4d7a-9e0b-b7742e3810bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.186782 Dec 15 16:31:15.996622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 592/1219] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:16.037887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:31:16.038132 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:31:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:31:16.947468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c503a699-c88a-4320-ac69-a4842159a641 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:16.948655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c503a699-c88a-4320-ac69-a4842159a641 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:16.957983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c503a699-c88a-4320-ac69-a4842159a641 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:16.958409 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c503a699-c88a-4320-ac69-a4842159a641 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:16.959216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c503a699-c88a-4320-ac69-a4842159a641 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:16.959680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c503a699-c88a-4320-ac69-a4842159a641 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:16.994183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c503a699-c88a-4320-ac69-a4842159a641 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051533 Dec 15 16:31:16.995182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 628/1220] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:16 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:17.015676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6b964541-975a-4f17-b6d4-ddac57d6339f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:17.016296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6b964541-975a-4f17-b6d4-ddac57d6339f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:17.023004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6b964541-975a-4f17-b6d4-ddac57d6339f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:17.023446 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6b964541-975a-4f17-b6d4-ddac57d6339f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:17.024253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6b964541-975a-4f17-b6d4-ddac57d6339f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:17.024716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6b964541-975a-4f17-b6d4-ddac57d6339f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:17.172110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6b964541-975a-4f17-b6d4-ddac57d6339f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:17.180184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6b964541-975a-4f17-b6d4-ddac57d6339f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168576 Dec 15 16:31:17.180795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 593/1221] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:17 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:18.007492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5af916c4-42df-45d8-9fca-c203fe5831fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:18.008564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5af916c4-42df-45d8-9fca-c203fe5831fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:18.015918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5af916c4-42df-45d8-9fca-c203fe5831fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:18.016364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5af916c4-42df-45d8-9fca-c203fe5831fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:18.017216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5af916c4-42df-45d8-9fca-c203fe5831fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:18.017645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5af916c4-42df-45d8-9fca-c203fe5831fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:18.050145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5af916c4-42df-45d8-9fca-c203fe5831fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046819 Dec 15 16:31:18.050745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 629/1222] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:18.198031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3ddf119f-966c-4634-98fb-b5837960663f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:18.198667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3ddf119f-966c-4634-98fb-b5837960663f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:18.206169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ddf119f-966c-4634-98fb-b5837960663f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:18.206625 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ddf119f-966c-4634-98fb-b5837960663f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:18.207426 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ddf119f-966c-4634-98fb-b5837960663f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:18.207854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ddf119f-966c-4634-98fb-b5837960663f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:18.359674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3ddf119f-966c-4634-98fb-b5837960663f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:18.367856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3ddf119f-966c-4634-98fb-b5837960663f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173746 Dec 15 16:31:18.368456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 594/1223] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:19.064910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a28c5ef7-c0f9-4d3b-943a-3ec97d0ccce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:19.065820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a28c5ef7-c0f9-4d3b-943a-3ec97d0ccce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:19.073105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a28c5ef7-c0f9-4d3b-943a-3ec97d0ccce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:19.073595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a28c5ef7-c0f9-4d3b-943a-3ec97d0ccce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:19.074448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a28c5ef7-c0f9-4d3b-943a-3ec97d0ccce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:19.074925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a28c5ef7-c0f9-4d3b-943a-3ec97d0ccce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:19.113185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a28c5ef7-c0f9-4d3b-943a-3ec97d0ccce1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052090 Dec 15 16:31:19.113763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 630/1224] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:19.154360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:31:19.154622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:31:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:31:19.386174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-165bfa7d-96a2-4089-a5f4-7a09ce991556 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:19.386865 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-165bfa7d-96a2-4089-a5f4-7a09ce991556 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:19.394075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-165bfa7d-96a2-4089-a5f4-7a09ce991556 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:19.394527 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-165bfa7d-96a2-4089-a5f4-7a09ce991556 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:19.395323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-165bfa7d-96a2-4089-a5f4-7a09ce991556 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:19.395760 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-165bfa7d-96a2-4089-a5f4-7a09ce991556 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:19.547566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-165bfa7d-96a2-4089-a5f4-7a09ce991556 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:19.557793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-165bfa7d-96a2-4089-a5f4-7a09ce991556 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.175247 Dec 15 16:31:19.558589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 595/1225] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:20.125674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-72451f98-4ccf-448c-b630-53b665e038ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:20.126581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-72451f98-4ccf-448c-b630-53b665e038ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:20.132996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72451f98-4ccf-448c-b630-53b665e038ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:20.133463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72451f98-4ccf-448c-b630-53b665e038ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:20.134229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72451f98-4ccf-448c-b630-53b665e038ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:20.134660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72451f98-4ccf-448c-b630-53b665e038ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:20.170366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-72451f98-4ccf-448c-b630-53b665e038ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048205 Dec 15 16:31:20.171011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 631/1226] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:20.583807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e6dfe735-8632-4c88-b781-922a6fb2cbe2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:20.584498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e6dfe735-8632-4c88-b781-922a6fb2cbe2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:20.591364 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e6dfe735-8632-4c88-b781-922a6fb2cbe2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:20.591807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e6dfe735-8632-4c88-b781-922a6fb2cbe2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:20.592717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e6dfe735-8632-4c88-b781-922a6fb2cbe2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:20.593181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e6dfe735-8632-4c88-b781-922a6fb2cbe2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:20.739091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e6dfe735-8632-4c88-b781-922a6fb2cbe2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:20.747365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e6dfe735-8632-4c88-b781-922a6fb2cbe2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.167309 Dec 15 16:31:20.747970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 596/1227] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:20 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:21.184135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ac0a0233-6c7b-46ed-8d63-689571528646 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:21.185086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ac0a0233-6c7b-46ed-8d63-689571528646 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:21.192404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ac0a0233-6c7b-46ed-8d63-689571528646 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:21.192880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ac0a0233-6c7b-46ed-8d63-689571528646 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:21.193679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ac0a0233-6c7b-46ed-8d63-689571528646 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:21.194118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ac0a0233-6c7b-46ed-8d63-689571528646 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:21.227513 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ac0a0233-6c7b-46ed-8d63-689571528646 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047861 Dec 15 16:31:21.228000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 632/1228] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:21.765171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0ea36546-b688-4586-9f1d-5d910c387c3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:21.765789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0ea36546-b688-4586-9f1d-5d910c387c3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:21.772243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ea36546-b688-4586-9f1d-5d910c387c3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:21.772711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ea36546-b688-4586-9f1d-5d910c387c3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:21.773518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ea36546-b688-4586-9f1d-5d910c387c3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:21.773928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0ea36546-b688-4586-9f1d-5d910c387c3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:21.922993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0ea36546-b688-4586-9f1d-5d910c387c3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:21.933220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0ea36546-b688-4586-9f1d-5d910c387c3b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171719 Dec 15 16:31:21.933811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 597/1229] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:22.240706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6cfb3973-db44-4d27-8676-f692c592c7bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:22.241534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6cfb3973-db44-4d27-8676-f692c592c7bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:22.248761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cfb3973-db44-4d27-8676-f692c592c7bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:22.249219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cfb3973-db44-4d27-8676-f692c592c7bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:22.250470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cfb3973-db44-4d27-8676-f692c592c7bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:22.251201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cfb3973-db44-4d27-8676-f692c592c7bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:22.286314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6cfb3973-db44-4d27-8676-f692c592c7bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050127 Dec 15 16:31:22.286937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 633/1230] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:22.951188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ae5eaa24-2a51-4ef2-b8cd-0bb5491cbdc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:22.951819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ae5eaa24-2a51-4ef2-b8cd-0bb5491cbdc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:22.958784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae5eaa24-2a51-4ef2-b8cd-0bb5491cbdc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:22.959226 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae5eaa24-2a51-4ef2-b8cd-0bb5491cbdc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:22.960019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae5eaa24-2a51-4ef2-b8cd-0bb5491cbdc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:22.960461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae5eaa24-2a51-4ef2-b8cd-0bb5491cbdc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:23.105842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ae5eaa24-2a51-4ef2-b8cd-0bb5491cbdc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:23.115335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ae5eaa24-2a51-4ef2-b8cd-0bb5491cbdc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.167821 Dec 15 16:31:23.115932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 598/1231] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:22 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:23.299243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-03626d8b-723c-4e9f-9fb6-6f67859faba9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:23.300098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-03626d8b-723c-4e9f-9fb6-6f67859faba9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:23.307489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-03626d8b-723c-4e9f-9fb6-6f67859faba9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:23.307936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-03626d8b-723c-4e9f-9fb6-6f67859faba9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:23.308783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-03626d8b-723c-4e9f-9fb6-6f67859faba9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:23.309217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-03626d8b-723c-4e9f-9fb6-6f67859faba9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:23.342301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-03626d8b-723c-4e9f-9fb6-6f67859faba9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047175 Dec 15 16:31:23.343276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 634/1232] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:24.132817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-80c77733-ac6d-4996-a82f-0f3a194f3e46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:24.133383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-80c77733-ac6d-4996-a82f-0f3a194f3e46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:24.140288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80c77733-ac6d-4996-a82f-0f3a194f3e46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:24.140863 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80c77733-ac6d-4996-a82f-0f3a194f3e46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:24.141652 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80c77733-ac6d-4996-a82f-0f3a194f3e46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:24.142080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80c77733-ac6d-4996-a82f-0f3a194f3e46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:24.295716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80c77733-ac6d-4996-a82f-0f3a194f3e46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:24.304059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-80c77733-ac6d-4996-a82f-0f3a194f3e46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174919 Dec 15 16:31:24.304639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 599/1233] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:24.354946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-72bb389c-8bba-4787-84fb-d0986cea2a6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:24.355869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-72bb389c-8bba-4787-84fb-d0986cea2a6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:24.363308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72bb389c-8bba-4787-84fb-d0986cea2a6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:24.363734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72bb389c-8bba-4787-84fb-d0986cea2a6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:24.364973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72bb389c-8bba-4787-84fb-d0986cea2a6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:24.365405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72bb389c-8bba-4787-84fb-d0986cea2a6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:24.398119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-72bb389c-8bba-4787-84fb-d0986cea2a6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046988 Dec 15 16:31:24.398596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 635/1234] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:25.323596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4a5bd24c-ab10-437f-9aec-6e3671a13dc2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:25.324262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4a5bd24c-ab10-437f-9aec-6e3671a13dc2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:25.331414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a5bd24c-ab10-437f-9aec-6e3671a13dc2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:25.331853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a5bd24c-ab10-437f-9aec-6e3671a13dc2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:25.333046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a5bd24c-ab10-437f-9aec-6e3671a13dc2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:25.333565 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a5bd24c-ab10-437f-9aec-6e3671a13dc2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:25.410052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-37d63975-c41e-48d2-9d1d-00fdff4a1ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:25.410909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-37d63975-c41e-48d2-9d1d-00fdff4a1ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:25.418089 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-37d63975-c41e-48d2-9d1d-00fdff4a1ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:25.418799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-37d63975-c41e-48d2-9d1d-00fdff4a1ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:25.419770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-37d63975-c41e-48d2-9d1d-00fdff4a1ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:25.420943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-37d63975-c41e-48d2-9d1d-00fdff4a1ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:25.454968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-37d63975-c41e-48d2-9d1d-00fdff4a1ac2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048823 Dec 15 16:31:25.455575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 636/1235] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:25.483971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4a5bd24c-ab10-437f-9aec-6e3671a13dc2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:25.492382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4a5bd24c-ab10-437f-9aec-6e3671a13dc2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.174168 Dec 15 16:31:25.492999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 600/1236] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:26.467117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fadca045-6d2d-4b22-b7a5-e5429ca95aec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:26.468294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fadca045-6d2d-4b22-b7a5-e5429ca95aec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:26.474811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fadca045-6d2d-4b22-b7a5-e5429ca95aec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:26.475259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fadca045-6d2d-4b22-b7a5-e5429ca95aec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:26.476051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fadca045-6d2d-4b22-b7a5-e5429ca95aec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:26.476522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fadca045-6d2d-4b22-b7a5-e5429ca95aec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:26.508154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fadca045-6d2d-4b22-b7a5-e5429ca95aec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044849 Dec 15 16:31:26.508773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 637/1237] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:26.510104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a014c8e6-4852-428b-aeb3-0119023580d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:26.510754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a014c8e6-4852-428b-aeb3-0119023580d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:26.518082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a014c8e6-4852-428b-aeb3-0119023580d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:26.518535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a014c8e6-4852-428b-aeb3-0119023580d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:26.519510 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a014c8e6-4852-428b-aeb3-0119023580d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:26.519974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a014c8e6-4852-428b-aeb3-0119023580d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:26.667008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a014c8e6-4852-428b-aeb3-0119023580d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:26.677105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a014c8e6-4852-428b-aeb3-0119023580d4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170088 Dec 15 16:31:26.677105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 601/1238] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:26 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:27.521069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-51ca201e-98b4-4b86-813e-ca66e7159ed9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:27.522018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-51ca201e-98b4-4b86-813e-ca66e7159ed9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:27.529411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51ca201e-98b4-4b86-813e-ca66e7159ed9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:27.529935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51ca201e-98b4-4b86-813e-ca66e7159ed9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:27.530984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51ca201e-98b4-4b86-813e-ca66e7159ed9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:27.531458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51ca201e-98b4-4b86-813e-ca66e7159ed9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:27.561643 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-51ca201e-98b4-4b86-813e-ca66e7159ed9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044928 Dec 15 16:31:27.562178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 638/1239] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:27.694279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b5753c29-bc0c-4788-b1c8-b2543ed3f193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:27.694869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b5753c29-bc0c-4788-b1c8-b2543ed3f193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:27.702075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5753c29-bc0c-4788-b1c8-b2543ed3f193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:27.702522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5753c29-bc0c-4788-b1c8-b2543ed3f193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:27.703310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5753c29-bc0c-4788-b1c8-b2543ed3f193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:27.703743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5753c29-bc0c-4788-b1c8-b2543ed3f193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:27.851044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b5753c29-bc0c-4788-b1c8-b2543ed3f193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:27.859198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b5753c29-bc0c-4788-b1c8-b2543ed3f193 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168583 Dec 15 16:31:27.860096 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 602/1240] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:28.574390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c96bd775-f752-4140-8f3a-0586c675edd8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:28.575340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c96bd775-f752-4140-8f3a-0586c675edd8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:28.583124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c96bd775-f752-4140-8f3a-0586c675edd8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:28.583631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c96bd775-f752-4140-8f3a-0586c675edd8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:28.584424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c96bd775-f752-4140-8f3a-0586c675edd8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:28.584925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c96bd775-f752-4140-8f3a-0586c675edd8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:28.615830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c96bd775-f752-4140-8f3a-0586c675edd8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046059 Dec 15 16:31:28.616373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 639/1241] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:28.878504 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-94f2c2b4-227d-4428-96b8-5f9a8c4f8542 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:28.879114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-94f2c2b4-227d-4428-96b8-5f9a8c4f8542 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:28.888151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94f2c2b4-227d-4428-96b8-5f9a8c4f8542 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:28.888730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94f2c2b4-227d-4428-96b8-5f9a8c4f8542 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:28.889860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94f2c2b4-227d-4428-96b8-5f9a8c4f8542 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:28.890467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94f2c2b4-227d-4428-96b8-5f9a8c4f8542 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:29.044629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-94f2c2b4-227d-4428-96b8-5f9a8c4f8542 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:29.052647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-94f2c2b4-227d-4428-96b8-5f9a8c4f8542 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.178909 Dec 15 16:31:29.053218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 603/1242] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:29.627741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-10264912-c623-47bc-826e-aa81377ae400 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:29.628852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-10264912-c623-47bc-826e-aa81377ae400 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:29.635649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10264912-c623-47bc-826e-aa81377ae400 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:29.636094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10264912-c623-47bc-826e-aa81377ae400 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:29.636919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10264912-c623-47bc-826e-aa81377ae400 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:29.637346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10264912-c623-47bc-826e-aa81377ae400 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:29.669373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-10264912-c623-47bc-826e-aa81377ae400 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045440 Dec 15 16:31:29.669941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 640/1243] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:30.070394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ad47ec51-d74f-458a-8789-727fea6c428c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:30.071027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ad47ec51-d74f-458a-8789-727fea6c428c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:30.078281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad47ec51-d74f-458a-8789-727fea6c428c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:30.079093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad47ec51-d74f-458a-8789-727fea6c428c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:30.080177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad47ec51-d74f-458a-8789-727fea6c428c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:30.080767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ad47ec51-d74f-458a-8789-727fea6c428c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:30.242260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ad47ec51-d74f-458a-8789-727fea6c428c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:30.251290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ad47ec51-d74f-458a-8789-727fea6c428c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.184706 Dec 15 16:31:30.251902 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 604/1244] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:30 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:30.681871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-907667af-3ccb-4934-bd2a-75343f79b97b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:30.682748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-907667af-3ccb-4934-bd2a-75343f79b97b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:30.689542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-907667af-3ccb-4934-bd2a-75343f79b97b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:30.689972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-907667af-3ccb-4934-bd2a-75343f79b97b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:30.690769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-907667af-3ccb-4934-bd2a-75343f79b97b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:30.691198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-907667af-3ccb-4934-bd2a-75343f79b97b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:30.721866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-907667af-3ccb-4934-bd2a-75343f79b97b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043806 Dec 15 16:31:30.722547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 641/1245] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:31.269460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7d1e0adc-012d-4dea-b24f-d3f8f6e4700b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:31.270045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7d1e0adc-012d-4dea-b24f-d3f8f6e4700b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:31.277097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adc-012d-4dea-b24f-d3f8f6e4700b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:31.277546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adc-012d-4dea-b24f-d3f8f6e4700b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:31.278327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adc-012d-4dea-b24f-d3f8f6e4700b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:31.278766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d1e0adc-012d-4dea-b24f-d3f8f6e4700b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:31.674280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7d1e0adc-012d-4dea-b24f-d3f8f6e4700b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:31.682176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7d1e0adc-012d-4dea-b24f-d3f8f6e4700b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.416599 Dec 15 16:31:31.682746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 605/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:31 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:31.733794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ee0522fa-181c-453e-b764-810006521e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:31.734740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ee0522fa-181c-453e-b764-810006521e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:31.742172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ee0522fa-181c-453e-b764-810006521e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:31.742623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ee0522fa-181c-453e-b764-810006521e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:31.743415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ee0522fa-181c-453e-b764-810006521e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:31.743849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ee0522fa-181c-453e-b764-810006521e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:31.775328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ee0522fa-181c-453e-b764-810006521e9d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045311 Dec 15 16:31:31.775910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 642/1247] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:32.698894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c9558b95-7507-4262-a405-b2ae38e8b383 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:32.699459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c9558b95-7507-4262-a405-b2ae38e8b383 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:32.701298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2814077c-fee9-4397-ac12-1ecc021be176 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:32.701911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2814077c-fee9-4397-ac12-1ecc021be176 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:32.706976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9558b95-7507-4262-a405-b2ae38e8b383 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:32.707295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9558b95-7507-4262-a405-b2ae38e8b383 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:32.708088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9558b95-7507-4262-a405-b2ae38e8b383 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:32.708560 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c9558b95-7507-4262-a405-b2ae38e8b383 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:32.712188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2814077c-fee9-4397-ac12-1ecc021be176 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:32.712664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2814077c-fee9-4397-ac12-1ecc021be176 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:32.713444 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2814077c-fee9-4397-ac12-1ecc021be176 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:32.713892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2814077c-fee9-4397-ac12-1ecc021be176 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:32.902310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2814077c-fee9-4397-ac12-1ecc021be176 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:32.911751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2814077c-fee9-4397-ac12-1ecc021be176 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.213926 Dec 15 16:31:32.912394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 643/1248] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:32.917097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-57e99271-e030-459c-8aba-f8acb305bd96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:32.918000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-57e99271-e030-459c-8aba-f8acb305bd96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:32.925399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57e99271-e030-459c-8aba-f8acb305bd96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:32.925966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57e99271-e030-459c-8aba-f8acb305bd96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:32.927142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57e99271-e030-459c-8aba-f8acb305bd96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:32.927756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57e99271-e030-459c-8aba-f8acb305bd96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:32.959543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-57e99271-e030-459c-8aba-f8acb305bd96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046041 Dec 15 16:31:32.960096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 644/1249] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:33.929516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d49c16d7-0690-4a2f-8e64-c11a26ad11c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:33.930372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d49c16d7-0690-4a2f-8e64-c11a26ad11c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:33.939172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d49c16d7-0690-4a2f-8e64-c11a26ad11c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:33.939615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d49c16d7-0690-4a2f-8e64-c11a26ad11c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:33.940379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d49c16d7-0690-4a2f-8e64-c11a26ad11c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:33.940835 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d49c16d7-0690-4a2f-8e64-c11a26ad11c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:34.107694 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d49c16d7-0690-4a2f-8e64-c11a26ad11c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:34.116753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d49c16d7-0690-4a2f-8e64-c11a26ad11c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.191121 Dec 15 16:31:34.117314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 645/1250] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:34.122192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-74a8fa2b-82f3-476a-9c3a-16e8c6f1b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:34.123148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-74a8fa2b-82f3-476a-9c3a-16e8c6f1b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:34.130846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74a8fa2b-82f3-476a-9c3a-16e8c6f1b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:34.131603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74a8fa2b-82f3-476a-9c3a-16e8c6f1b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:34.132924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74a8fa2b-82f3-476a-9c3a-16e8c6f1b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:34.133600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-74a8fa2b-82f3-476a-9c3a-16e8c6f1b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:34.166808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-74a8fa2b-82f3-476a-9c3a-16e8c6f1b655 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048424 Dec 15 16:31:34.167355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 646/1251] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:35.134653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2d8649c8-a012-452a-9bee-a23ffb92ca50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:35.135313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2d8649c8-a012-452a-9bee-a23ffb92ca50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:35.142152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d8649c8-a012-452a-9bee-a23ffb92ca50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:35.142597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d8649c8-a012-452a-9bee-a23ffb92ca50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:35.143378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d8649c8-a012-452a-9bee-a23ffb92ca50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:35.143808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d8649c8-a012-452a-9bee-a23ffb92ca50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:35.276352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2d8649c8-a012-452a-9bee-a23ffb92ca50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:35.284882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2d8649c8-a012-452a-9bee-a23ffb92ca50 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.154512 Dec 15 16:31:35.285449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 647/1252] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:35.289804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a2a1a2e4-ab65-4966-822b-2476adcb0402 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:35.290687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a2a1a2e4-ab65-4966-822b-2476adcb0402 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:35.297481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2a1a2e4-ab65-4966-822b-2476adcb0402 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:35.297936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2a1a2e4-ab65-4966-822b-2476adcb0402 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:35.298726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2a1a2e4-ab65-4966-822b-2476adcb0402 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:35.299163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2a1a2e4-ab65-4966-822b-2476adcb0402 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:35.335521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a2a1a2e4-ab65-4966-822b-2476adcb0402 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048774 Dec 15 16:31:35.336263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 648/1253] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:36.306940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-da92fb68-da85-4115-8e6e-822a637c8218 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:36.308098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-da92fb68-da85-4115-8e6e-822a637c8218 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:36.316693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-da92fb68-da85-4115-8e6e-822a637c8218 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:36.317135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-da92fb68-da85-4115-8e6e-822a637c8218 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:36.317931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-da92fb68-da85-4115-8e6e-822a637c8218 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:36.318357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-da92fb68-da85-4115-8e6e-822a637c8218 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:36.477950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-da92fb68-da85-4115-8e6e-822a637c8218 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:36.486226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-da92fb68-da85-4115-8e6e-822a637c8218 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.187567 Dec 15 16:31:36.486795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 649/1254] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:36 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:36.492970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-86d54da4-d7cb-4b5b-ada7-6772d6bb99d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:36.493872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-86d54da4-d7cb-4b5b-ada7-6772d6bb99d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:36.500304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86d54da4-d7cb-4b5b-ada7-6772d6bb99d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:36.500752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86d54da4-d7cb-4b5b-ada7-6772d6bb99d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:36.501786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86d54da4-d7cb-4b5b-ada7-6772d6bb99d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:36.502244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86d54da4-d7cb-4b5b-ada7-6772d6bb99d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:36.538407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-86d54da4-d7cb-4b5b-ada7-6772d6bb99d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049953 Dec 15 16:31:36.539002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 650/1255] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:37.507516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0d26ce00-0d74-4b26-b221-ee1f51d88fbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:37.509202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0d26ce00-0d74-4b26-b221-ee1f51d88fbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:37.519993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d26ce00-0d74-4b26-b221-ee1f51d88fbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:37.520843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d26ce00-0d74-4b26-b221-ee1f51d88fbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:37.522204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d26ce00-0d74-4b26-b221-ee1f51d88fbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:37.522924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d26ce00-0d74-4b26-b221-ee1f51d88fbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:37.667765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0d26ce00-0d74-4b26-b221-ee1f51d88fbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:37.678363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0d26ce00-0d74-4b26-b221-ee1f51d88fbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176490 Dec 15 16:31:37.679121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 651/1256] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:37 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:31:37.685321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8ce49115-44df-4057-9e18-de4080f69387 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:37.686656 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8ce49115-44df-4057-9e18-de4080f69387 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:37.693590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ce49115-44df-4057-9e18-de4080f69387 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:37.694066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ce49115-44df-4057-9e18-de4080f69387 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:37.694865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ce49115-44df-4057-9e18-de4080f69387 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:37.695302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ce49115-44df-4057-9e18-de4080f69387 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:37.728037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8ce49115-44df-4057-9e18-de4080f69387 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047882 Dec 15 16:31:37.728635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 652/1257] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:38.701842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c1488ab1-f8ce-4b99-a018-0ef9a25cb1bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:38.702545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c1488ab1-f8ce-4b99-a018-0ef9a25cb1bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:38.710087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c1488ab1-f8ce-4b99-a018-0ef9a25cb1bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:38.710515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c1488ab1-f8ce-4b99-a018-0ef9a25cb1bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:38.711293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c1488ab1-f8ce-4b99-a018-0ef9a25cb1bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:38.711724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c1488ab1-f8ce-4b99-a018-0ef9a25cb1bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:38.864861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c1488ab1-f8ce-4b99-a018-0ef9a25cb1bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:38.876238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c1488ab1-f8ce-4b99-a018-0ef9a25cb1bd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.179939 Dec 15 16:31:38.876846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 653/1258] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:38.881274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-01d1d507-9b26-4ce1-88a0-72089c37c7eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:38.882156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-01d1d507-9b26-4ce1-88a0-72089c37c7eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:38.888061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-01d1d507-9b26-4ce1-88a0-72089c37c7eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:38.888718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-01d1d507-9b26-4ce1-88a0-72089c37c7eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:38.889496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-01d1d507-9b26-4ce1-88a0-72089c37c7eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:38.889924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-01d1d507-9b26-4ce1-88a0-72089c37c7eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:38.925836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-01d1d507-9b26-4ce1-88a0-72089c37c7eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047952 Dec 15 16:31:38.926398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 654/1259] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:39.898515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0c3e9cbc-a302-4a12-b807-983c9b0101cb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:39.899451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0c3e9cbc-a302-4a12-b807-983c9b0101cb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:39.909037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c3e9cbc-a302-4a12-b807-983c9b0101cb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:39.909550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c3e9cbc-a302-4a12-b807-983c9b0101cb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:39.910326 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c3e9cbc-a302-4a12-b807-983c9b0101cb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:39.910753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c3e9cbc-a302-4a12-b807-983c9b0101cb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:40.064401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0c3e9cbc-a302-4a12-b807-983c9b0101cb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:40.072339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0c3e9cbc-a302-4a12-b807-983c9b0101cb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.180446 Dec 15 16:31:40.072948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 655/1260] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:40.078988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e2b8eac6-e0f3-4a53-bb6a-1ad148825112 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:40.079871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e2b8eac6-e0f3-4a53-bb6a-1ad148825112 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:40.086158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2b8eac6-e0f3-4a53-bb6a-1ad148825112 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:40.086627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2b8eac6-e0f3-4a53-bb6a-1ad148825112 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:40.087414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2b8eac6-e0f3-4a53-bb6a-1ad148825112 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:40.087869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e2b8eac6-e0f3-4a53-bb6a-1ad148825112 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:40.122049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e2b8eac6-e0f3-4a53-bb6a-1ad148825112 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048042 Dec 15 16:31:40.122604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 656/1261] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:41.091866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4810f4aa-0b11-4b7d-9db4-0abf60044bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:41.092610 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4810f4aa-0b11-4b7d-9db4-0abf60044bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:41.099743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4810f4aa-0b11-4b7d-9db4-0abf60044bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:41.100181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4810f4aa-0b11-4b7d-9db4-0abf60044bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:41.101003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4810f4aa-0b11-4b7d-9db4-0abf60044bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:41.101455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4810f4aa-0b11-4b7d-9db4-0abf60044bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:41.245038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4810f4aa-0b11-4b7d-9db4-0abf60044bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:41.254199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4810f4aa-0b11-4b7d-9db4-0abf60044bfc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166079 Dec 15 16:31:41.254777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 657/1262] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:41 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:41.259265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-830fe60a-652a-4456-8adb-cc654c3bb3ef tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:41.261073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-830fe60a-652a-4456-8adb-cc654c3bb3ef tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:41.268631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-830fe60a-652a-4456-8adb-cc654c3bb3ef tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:41.268631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-830fe60a-652a-4456-8adb-cc654c3bb3ef tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:41.269537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-830fe60a-652a-4456-8adb-cc654c3bb3ef tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:41.269972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-830fe60a-652a-4456-8adb-cc654c3bb3ef tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:41.299118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-830fe60a-652a-4456-8adb-cc654c3bb3ef tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043310 Dec 15 16:31:41.299676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 658/1263] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:42.271817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c8aeed1b-8063-453c-bc66-23944686c0dd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:42.272560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c8aeed1b-8063-453c-bc66-23944686c0dd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:42.279307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c8aeed1b-8063-453c-bc66-23944686c0dd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:42.279747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c8aeed1b-8063-453c-bc66-23944686c0dd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:42.280555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c8aeed1b-8063-453c-bc66-23944686c0dd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:42.280971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c8aeed1b-8063-453c-bc66-23944686c0dd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:42.439334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c8aeed1b-8063-453c-bc66-23944686c0dd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:42.447339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c8aeed1b-8063-453c-bc66-23944686c0dd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.179199 Dec 15 16:31:42.448047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 659/1264] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:42 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:42.452526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3d572b7f-b0fb-4185-aeb6-12b6b1b698e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:42.453525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3d572b7f-b0fb-4185-aeb6-12b6b1b698e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:42.459619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d572b7f-b0fb-4185-aeb6-12b6b1b698e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:42.460061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d572b7f-b0fb-4185-aeb6-12b6b1b698e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:42.460876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d572b7f-b0fb-4185-aeb6-12b6b1b698e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:42.461302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d572b7f-b0fb-4185-aeb6-12b6b1b698e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:42.493292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3d572b7f-b0fb-4185-aeb6-12b6b1b698e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044164 Dec 15 16:31:42.493863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 660/1265] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:43.465414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c63eb5fa-e6a3-4854-bb70-872ea0775876 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:43.466096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c63eb5fa-e6a3-4854-bb70-872ea0775876 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:43.473400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c63eb5fa-e6a3-4854-bb70-872ea0775876 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:43.473847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c63eb5fa-e6a3-4854-bb70-872ea0775876 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:43.474638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c63eb5fa-e6a3-4854-bb70-872ea0775876 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:43.475072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c63eb5fa-e6a3-4854-bb70-872ea0775876 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:43.625443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c63eb5fa-e6a3-4854-bb70-872ea0775876 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:43.633292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c63eb5fa-e6a3-4854-bb70-872ea0775876 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.171639 Dec 15 16:31:43.633873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 661/1266] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:43 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:43.638306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3854dcc4-0886-4f31-8af3-fc46f7b265d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:43.639213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3854dcc4-0886-4f31-8af3-fc46f7b265d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:43.645675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3854dcc4-0886-4f31-8af3-fc46f7b265d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:43.646129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3854dcc4-0886-4f31-8af3-fc46f7b265d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:43.646926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3854dcc4-0886-4f31-8af3-fc46f7b265d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:43.647362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3854dcc4-0886-4f31-8af3-fc46f7b265d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:43.679671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3854dcc4-0886-4f31-8af3-fc46f7b265d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044732 Dec 15 16:31:43.680268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 662/1267] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:44.650752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e6ee09ef-7144-4130-b472-657a4cbbba7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:44.651492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e6ee09ef-7144-4130-b472-657a4cbbba7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:44.663760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6ee09ef-7144-4130-b472-657a4cbbba7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:44.664210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6ee09ef-7144-4130-b472-657a4cbbba7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:44.665051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6ee09ef-7144-4130-b472-657a4cbbba7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:44.665741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6ee09ef-7144-4130-b472-657a4cbbba7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:44.817433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e6ee09ef-7144-4130-b472-657a4cbbba7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:44.825334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e6ee09ef-7144-4130-b472-657a4cbbba7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.178241 Dec 15 16:31:44.825921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 663/1268] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:44.830696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e9d65439-65c1-4d95-894c-616139d60e22 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:44.831612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e9d65439-65c1-4d95-894c-616139d60e22 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:44.841387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9d65439-65c1-4d95-894c-616139d60e22 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:44.842221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9d65439-65c1-4d95-894c-616139d60e22 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:44.844083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9d65439-65c1-4d95-894c-616139d60e22 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:44.844928 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9d65439-65c1-4d95-894c-616139d60e22 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:44.879903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e9d65439-65c1-4d95-894c-616139d60e22 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052841 Dec 15 16:31:44.880537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 664/1269] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:45.844265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-374b7b76-eda3-430b-83f2-6ca391dc1dc1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:45.845030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-374b7b76-eda3-430b-83f2-6ca391dc1dc1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:45.852028 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-374b7b76-eda3-430b-83f2-6ca391dc1dc1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:45.852540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-374b7b76-eda3-430b-83f2-6ca391dc1dc1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:45.853341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-374b7b76-eda3-430b-83f2-6ca391dc1dc1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:45.853775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-374b7b76-eda3-430b-83f2-6ca391dc1dc1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:45.995537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-374b7b76-eda3-430b-83f2-6ca391dc1dc1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:46.005021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-374b7b76-eda3-430b-83f2-6ca391dc1dc1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165348 Dec 15 16:31:46.005810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 665/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:31:46.010409 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-45fe3a26-938b-4e09-9b2f-e6ba32614348 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:46.011418 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-45fe3a26-938b-4e09-9b2f-e6ba32614348 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:46.017837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-45fe3a26-938b-4e09-9b2f-e6ba32614348 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:46.018266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-45fe3a26-938b-4e09-9b2f-e6ba32614348 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:46.019053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-45fe3a26-938b-4e09-9b2f-e6ba32614348 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:46.019470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-45fe3a26-938b-4e09-9b2f-e6ba32614348 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:46.049188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-45fe3a26-938b-4e09-9b2f-e6ba32614348 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042520 Dec 15 16:31:46.049746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 666/1271] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:47.022272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aec40202-8164-4dec-82fc-202097ea0d2e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:47.022967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aec40202-8164-4dec-82fc-202097ea0d2e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:47.029630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aec40202-8164-4dec-82fc-202097ea0d2e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:47.030082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aec40202-8164-4dec-82fc-202097ea0d2e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:47.031452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aec40202-8164-4dec-82fc-202097ea0d2e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:47.031892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aec40202-8164-4dec-82fc-202097ea0d2e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:47.175539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-aec40202-8164-4dec-82fc-202097ea0d2e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:47.187872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aec40202-8164-4dec-82fc-202097ea0d2e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169293 Dec 15 16:31:47.188464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 667/1272] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:47.192920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5ea1bec9-8af1-42a6-8c48-aa58ffcc5ad7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:47.193816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5ea1bec9-8af1-42a6-8c48-aa58ffcc5ad7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:47.199517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ea1bec9-8af1-42a6-8c48-aa58ffcc5ad7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:47.199961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ea1bec9-8af1-42a6-8c48-aa58ffcc5ad7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:47.200808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ea1bec9-8af1-42a6-8c48-aa58ffcc5ad7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:47.201239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ea1bec9-8af1-42a6-8c48-aa58ffcc5ad7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:47.234991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5ea1bec9-8af1-42a6-8c48-aa58ffcc5ad7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044828 Dec 15 16:31:47.235644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 668/1273] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:48.205634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f23a790a-297d-40d1-91be-2f5f31baa602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:48.206397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f23a790a-297d-40d1-91be-2f5f31baa602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:48.212786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f23a790a-297d-40d1-91be-2f5f31baa602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:48.213236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f23a790a-297d-40d1-91be-2f5f31baa602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:48.214005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f23a790a-297d-40d1-91be-2f5f31baa602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:48.214435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f23a790a-297d-40d1-91be-2f5f31baa602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:48.371286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f23a790a-297d-40d1-91be-2f5f31baa602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:48.379041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f23a790a-297d-40d1-91be-2f5f31baa602 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.177226 Dec 15 16:31:48.379560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 669/1274] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:31:48.383987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-085e8b84-fa0d-402f-8c85-ab19731dd947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:48.384968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-085e8b84-fa0d-402f-8c85-ab19731dd947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:48.390992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-085e8b84-fa0d-402f-8c85-ab19731dd947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:48.391451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-085e8b84-fa0d-402f-8c85-ab19731dd947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:48.392307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-085e8b84-fa0d-402f-8c85-ab19731dd947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:48.392772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-085e8b84-fa0d-402f-8c85-ab19731dd947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:48.422476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-085e8b84-fa0d-402f-8c85-ab19731dd947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041847 Dec 15 16:31:48.423402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 670/1275] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:48 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:49.396049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4167180c-f18b-4ab1-920d-ddee28f4adcb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:49.396768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4167180c-f18b-4ab1-920d-ddee28f4adcb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:49.403525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4167180c-f18b-4ab1-920d-ddee28f4adcb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:49.403964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4167180c-f18b-4ab1-920d-ddee28f4adcb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:49.404776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4167180c-f18b-4ab1-920d-ddee28f4adcb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:49.405198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4167180c-f18b-4ab1-920d-ddee28f4adcb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:49.542868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4167180c-f18b-4ab1-920d-ddee28f4adcb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:49.555595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4167180c-f18b-4ab1-920d-ddee28f4adcb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.163408 Dec 15 16:31:49.563039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 671/1276] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:49 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:49.563039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1c8a3bab-98c0-4bfd-85e1-a468e05c06e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:49.563039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1c8a3bab-98c0-4bfd-85e1-a468e05c06e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:49.567903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c8a3bab-98c0-4bfd-85e1-a468e05c06e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:49.568354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c8a3bab-98c0-4bfd-85e1-a468e05c06e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:49.569150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c8a3bab-98c0-4bfd-85e1-a468e05c06e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:49.569576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c8a3bab-98c0-4bfd-85e1-a468e05c06e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:49.600377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1c8a3bab-98c0-4bfd-85e1-a468e05c06e6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042721 Dec 15 16:31:49.600969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 672/1277] 10.222.0.30 () {60 vars in 1342 bytes} [Wed Dec 15 16:31:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:31:50.572823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6424341d-ba76-49c4-a258-55e1490388f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:50.573548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6424341d-ba76-49c4-a258-55e1490388f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:50.580031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6424341d-ba76-49c4-a258-55e1490388f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:50.580460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6424341d-ba76-49c4-a258-55e1490388f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:50.581347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6424341d-ba76-49c4-a258-55e1490388f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:50.581890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6424341d-ba76-49c4-a258-55e1490388f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:50.731287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6424341d-ba76-49c4-a258-55e1490388f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:50.739922 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6424341d-ba76-49c4-a258-55e1490388f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170821 Dec 15 16:31:50.740521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 673/1278] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:50 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:50.745284 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d025b7bb-b2f7-4e9c-8fcd-2ba11b22384c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:31:50.746219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d025b7bb-b2f7-4e9c-8fcd-2ba11b22384c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:50.752599 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d025b7bb-b2f7-4e9c-8fcd-2ba11b22384c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:50.753066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d025b7bb-b2f7-4e9c-8fcd-2ba11b22384c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:50.754043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d025b7bb-b2f7-4e9c-8fcd-2ba11b22384c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:50.754634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d025b7bb-b2f7-4e9c-8fcd-2ba11b22384c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:50.837745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d025b7bb-b2f7-4e9c-8fcd-2ba11b22384c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action" status: 200 len: 38143 microversion: 2.20 time: 0.095953 Dec 15 16:31:50.838381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 674/1279] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:31:50 2021] POST /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f/action => generated 38143 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:31:51.764537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a770491f-42fb-4df6-81e6-2a436cc58f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:51.765215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a770491f-42fb-4df6-81e6-2a436cc58f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:51.772373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a770491f-42fb-4df6-81e6-2a436cc58f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:51.772856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a770491f-42fb-4df6-81e6-2a436cc58f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:51.773630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a770491f-42fb-4df6-81e6-2a436cc58f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:51.774042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a770491f-42fb-4df6-81e6-2a436cc58f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:51.920566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a770491f-42fb-4df6-81e6-2a436cc58f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:51.929002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a770491f-42fb-4df6-81e6-2a436cc58f75 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168571 Dec 15 16:31:51.929548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 675/1280] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:52.946645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-976a1373-fcf8-412a-8664-72b45e65c184 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:52.947363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-976a1373-fcf8-412a-8664-72b45e65c184 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:52.953758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-976a1373-fcf8-412a-8664-72b45e65c184 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:52.954218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-976a1373-fcf8-412a-8664-72b45e65c184 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:52.955024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-976a1373-fcf8-412a-8664-72b45e65c184 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:52.955486 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-976a1373-fcf8-412a-8664-72b45e65c184 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:53.091348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-976a1373-fcf8-412a-8664-72b45e65c184 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:53.099143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-976a1373-fcf8-412a-8664-72b45e65c184 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.157233 Dec 15 16:31:53.100126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 676/1281] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:54.118672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0da19382-e15f-4f20-80e2-49c60befb292 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:54.119347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0da19382-e15f-4f20-80e2-49c60befb292 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:54.126170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0da19382-e15f-4f20-80e2-49c60befb292 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:54.126629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0da19382-e15f-4f20-80e2-49c60befb292 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:54.127423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0da19382-e15f-4f20-80e2-49c60befb292 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:54.127860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0da19382-e15f-4f20-80e2-49c60befb292 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:54.276404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0da19382-e15f-4f20-80e2-49c60befb292 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:54.287353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0da19382-e15f-4f20-80e2-49c60befb292 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173061 Dec 15 16:31:54.288173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 677/1282] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:54 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:55.305502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-93580c91-42ab-40ef-9946-ed3613373426 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:55.306257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-93580c91-42ab-40ef-9946-ed3613373426 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:55.315403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93580c91-42ab-40ef-9946-ed3613373426 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:55.315403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93580c91-42ab-40ef-9946-ed3613373426 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:55.315403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93580c91-42ab-40ef-9946-ed3613373426 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:55.315403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93580c91-42ab-40ef-9946-ed3613373426 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:55.455914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-93580c91-42ab-40ef-9946-ed3613373426 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:55.467980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-93580c91-42ab-40ef-9946-ed3613373426 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165947 Dec 15 16:31:55.468814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 678/1283] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:31:56.486123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a9b238b1-16c5-46b9-9061-aa75c012da77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:56.486809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a9b238b1-16c5-46b9-9061-aa75c012da77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:56.493845 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9b238b1-16c5-46b9-9061-aa75c012da77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:56.494285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9b238b1-16c5-46b9-9061-aa75c012da77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:56.495062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9b238b1-16c5-46b9-9061-aa75c012da77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:56.495494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a9b238b1-16c5-46b9-9061-aa75c012da77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:56.647011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a9b238b1-16c5-46b9-9061-aa75c012da77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:56.655097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a9b238b1-16c5-46b9-9061-aa75c012da77 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.173175 Dec 15 16:31:56.655687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 679/1284] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:57.676370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-09a4fa27-746b-4f24-b319-cd6779114deb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:57.677127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-09a4fa27-746b-4f24-b319-cd6779114deb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:57.686662 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09a4fa27-746b-4f24-b319-cd6779114deb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:57.687524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09a4fa27-746b-4f24-b319-cd6779114deb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:57.688948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09a4fa27-746b-4f24-b319-cd6779114deb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:57.689631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09a4fa27-746b-4f24-b319-cd6779114deb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:57.833005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-09a4fa27-746b-4f24-b319-cd6779114deb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:57.841890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-09a4fa27-746b-4f24-b319-cd6779114deb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170585 Dec 15 16:31:57.842458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 680/1285] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:58.867246 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ea8840b6-6bd8-4d85-8db8-2c7b70b1d307 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:58.867985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ea8840b6-6bd8-4d85-8db8-2c7b70b1d307 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:58.874830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ea8840b6-6bd8-4d85-8db8-2c7b70b1d307 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:58.875271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ea8840b6-6bd8-4d85-8db8-2c7b70b1d307 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:58.876056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ea8840b6-6bd8-4d85-8db8-2c7b70b1d307 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:58.876488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ea8840b6-6bd8-4d85-8db8-2c7b70b1d307 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:59.023338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ea8840b6-6bd8-4d85-8db8-2c7b70b1d307 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:59.034093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ea8840b6-6bd8-4d85-8db8-2c7b70b1d307 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.170801 Dec 15 16:31:59.034801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 681/1286] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:00.052944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4a10f30d-be23-4d7c-8715-45bf66792e96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:00.053616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4a10f30d-be23-4d7c-8715-45bf66792e96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:00.060725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4a10f30d-be23-4d7c-8715-45bf66792e96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:00.061170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4a10f30d-be23-4d7c-8715-45bf66792e96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:00.061953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4a10f30d-be23-4d7c-8715-45bf66792e96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:00.062382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4a10f30d-be23-4d7c-8715-45bf66792e96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:00.203449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4a10f30d-be23-4d7c-8715-45bf66792e96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:00.212399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4a10f30d-be23-4d7c-8715-45bf66792e96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.163258 Dec 15 16:32:00.213000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 682/1287] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:01.236394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-974d0726-35c7-4065-8143-3d690026042c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:01.237111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-974d0726-35c7-4065-8143-3d690026042c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:01.244505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-974d0726-35c7-4065-8143-3d690026042c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:01.245027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-974d0726-35c7-4065-8143-3d690026042c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:01.245865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-974d0726-35c7-4065-8143-3d690026042c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:01.246352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-974d0726-35c7-4065-8143-3d690026042c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:01.395639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-974d0726-35c7-4065-8143-3d690026042c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:01.404118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-974d0726-35c7-4065-8143-3d690026042c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172370 Dec 15 16:32:01.404720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 683/1288] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:02.424265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cbfda87d-5558-462d-86b6-b41bac786f37 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:02.424913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cbfda87d-5558-462d-86b6-b41bac786f37 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:02.431778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbfda87d-5558-462d-86b6-b41bac786f37 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:02.432240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbfda87d-5558-462d-86b6-b41bac786f37 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:02.433048 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbfda87d-5558-462d-86b6-b41bac786f37 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:02.433456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbfda87d-5558-462d-86b6-b41bac786f37 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:02.654470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cbfda87d-5558-462d-86b6-b41bac786f37 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:02.662725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cbfda87d-5558-462d-86b6-b41bac786f37 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.241782 Dec 15 16:32:02.663376 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 684/1289] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:03.681930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bade4355-01c1-48aa-ab20-092d9ed8620c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:03.683013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bade4355-01c1-48aa-ab20-092d9ed8620c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:03.691381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bade4355-01c1-48aa-ab20-092d9ed8620c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:03.691800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bade4355-01c1-48aa-ab20-092d9ed8620c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:03.692813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bade4355-01c1-48aa-ab20-092d9ed8620c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:03.693352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bade4355-01c1-48aa-ab20-092d9ed8620c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:03.847231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bade4355-01c1-48aa-ab20-092d9ed8620c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:03.855524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bade4355-01c1-48aa-ab20-092d9ed8620c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.178453 Dec 15 16:32:03.856091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 685/1290] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:03 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:04.878475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5e332284-656d-4cc3-9c94-23d5f3a02943 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:04.879192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5e332284-656d-4cc3-9c94-23d5f3a02943 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:04.888362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e332284-656d-4cc3-9c94-23d5f3a02943 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:04.888946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e332284-656d-4cc3-9c94-23d5f3a02943 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:04.889937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e332284-656d-4cc3-9c94-23d5f3a02943 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:04.890373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e332284-656d-4cc3-9c94-23d5f3a02943 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:05.047306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5e332284-656d-4cc3-9c94-23d5f3a02943 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:05.059124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5e332284-656d-4cc3-9c94-23d5f3a02943 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.186107 Dec 15 16:32:05.059686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 686/1291] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:06.079257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8b50dfd1-0ae4-4bb8-859a-be06b48eb72f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:06.079980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8b50dfd1-0ae4-4bb8-859a-be06b48eb72f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:06.086931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b50dfd1-0ae4-4bb8-859a-be06b48eb72f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:06.087380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b50dfd1-0ae4-4bb8-859a-be06b48eb72f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:06.088166 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b50dfd1-0ae4-4bb8-859a-be06b48eb72f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:06.088636 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b50dfd1-0ae4-4bb8-859a-be06b48eb72f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:06.236159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8b50dfd1-0ae4-4bb8-859a-be06b48eb72f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:06.244972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8b50dfd1-0ae4-4bb8-859a-be06b48eb72f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169463 Dec 15 16:32:06.245539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 687/1292] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:07.264760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f38e5b58-2329-4d94-aa9a-3c35d3559f1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:07.265453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f38e5b58-2329-4d94-aa9a-3c35d3559f1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:07.273982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f38e5b58-2329-4d94-aa9a-3c35d3559f1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:07.274586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f38e5b58-2329-4d94-aa9a-3c35d3559f1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:07.275713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f38e5b58-2329-4d94-aa9a-3c35d3559f1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:07.276288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f38e5b58-2329-4d94-aa9a-3c35d3559f1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:07.426546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f38e5b58-2329-4d94-aa9a-3c35d3559f1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:07.434077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f38e5b58-2329-4d94-aa9a-3c35d3559f1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.175140 Dec 15 16:32:07.434676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 688/1293] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:07 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:08.451385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-53ff3d95-03a2-4ed0-93fc-226aef117b49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:08.452120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-53ff3d95-03a2-4ed0-93fc-226aef117b49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:08.459080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53ff3d95-03a2-4ed0-93fc-226aef117b49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:08.459527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53ff3d95-03a2-4ed0-93fc-226aef117b49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:08.460303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53ff3d95-03a2-4ed0-93fc-226aef117b49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:08.460759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53ff3d95-03a2-4ed0-93fc-226aef117b49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:08.615862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-53ff3d95-03a2-4ed0-93fc-226aef117b49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:08.623802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-53ff3d95-03a2-4ed0-93fc-226aef117b49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176156 Dec 15 16:32:08.624371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 689/1294] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:09.641332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7e5f42f7-a6c8-48d3-a694-aa7752afbc15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:09.642070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7e5f42f7-a6c8-48d3-a694-aa7752afbc15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:09.649479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e5f42f7-a6c8-48d3-a694-aa7752afbc15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:09.649956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e5f42f7-a6c8-48d3-a694-aa7752afbc15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:09.650708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e5f42f7-a6c8-48d3-a694-aa7752afbc15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:09.651137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e5f42f7-a6c8-48d3-a694-aa7752afbc15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:09.801986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7e5f42f7-a6c8-48d3-a694-aa7752afbc15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:09.810325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7e5f42f7-a6c8-48d3-a694-aa7752afbc15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.172742 Dec 15 16:32:09.810899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 690/1295] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:10.829396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5f964f88-580d-4a34-b417-152d45a861f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:10.830195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5f964f88-580d-4a34-b417-152d45a861f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:10.838753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f964f88-580d-4a34-b417-152d45a861f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:10.839194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f964f88-580d-4a34-b417-152d45a861f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:10.839976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f964f88-580d-4a34-b417-152d45a861f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:10.840403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f964f88-580d-4a34-b417-152d45a861f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:10.981948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5f964f88-580d-4a34-b417-152d45a861f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:10.993766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5f964f88-580d-4a34-b417-152d45a861f5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168231 Dec 15 16:32:10.994503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 691/1296] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:12.014576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-31a25f43-7a51-4c57-af5e-d3551c6b11e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:12.015240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-31a25f43-7a51-4c57-af5e-d3551c6b11e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:12.022170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31a25f43-7a51-4c57-af5e-d3551c6b11e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:12.022626 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31a25f43-7a51-4c57-af5e-d3551c6b11e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:12.023424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31a25f43-7a51-4c57-af5e-d3551c6b11e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:12.023854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31a25f43-7a51-4c57-af5e-d3551c6b11e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:12.166728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-31a25f43-7a51-4c57-af5e-d3551c6b11e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:12.177751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-31a25f43-7a51-4c57-af5e-d3551c6b11e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.166969 Dec 15 16:32:12.178343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 692/1297] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:12 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:13.195176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5280331a-2101-4b05-acd3-c2e1e0cd62ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:13.195875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5280331a-2101-4b05-acd3-c2e1e0cd62ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:13.202424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5280331a-2101-4b05-acd3-c2e1e0cd62ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:13.202869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5280331a-2101-4b05-acd3-c2e1e0cd62ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:13.203652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5280331a-2101-4b05-acd3-c2e1e0cd62ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:13.204079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5280331a-2101-4b05-acd3-c2e1e0cd62ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:13.506309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5280331a-2101-4b05-acd3-c2e1e0cd62ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:13.517115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5280331a-2101-4b05-acd3-c2e1e0cd62ee tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.325387 Dec 15 16:32:13.517912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 693/1298] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:14.535360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-966aa3b3-9bba-4e9b-ae5e-0f51b9480c67 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:14.536049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-966aa3b3-9bba-4e9b-ae5e-0f51b9480c67 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:14.542988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-966aa3b3-9bba-4e9b-ae5e-0f51b9480c67 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:14.543429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-966aa3b3-9bba-4e9b-ae5e-0f51b9480c67 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:14.544200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-966aa3b3-9bba-4e9b-ae5e-0f51b9480c67 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:14.544680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-966aa3b3-9bba-4e9b-ae5e-0f51b9480c67 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:14.686010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-966aa3b3-9bba-4e9b-ae5e-0f51b9480c67 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:14.693870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-966aa3b3-9bba-4e9b-ae5e-0f51b9480c67 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.162246 Dec 15 16:32:14.694407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 694/1299] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:15.712987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7e225b90-b3ec-43f6-b71d-1cecbb612633 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:15.713613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7e225b90-b3ec-43f6-b71d-1cecbb612633 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:15.722809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e225b90-b3ec-43f6-b71d-1cecbb612633 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:15.723350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e225b90-b3ec-43f6-b71d-1cecbb612633 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:15.724451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e225b90-b3ec-43f6-b71d-1cecbb612633 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:15.725129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e225b90-b3ec-43f6-b71d-1cecbb612633 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:15.875154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7e225b90-b3ec-43f6-b71d-1cecbb612633 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:15.883448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7e225b90-b3ec-43f6-b71d-1cecbb612633 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.176649 Dec 15 16:32:15.884003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 695/1300] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:32:16.904201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-93c4b674-3f30-40d9-bc85-6f23f9ea1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:16.905299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-93c4b674-3f30-40d9-bc85-6f23f9ea1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:16.914555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93c4b674-3f30-40d9-bc85-6f23f9ea1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:16.915011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93c4b674-3f30-40d9-bc85-6f23f9ea1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:16.915795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93c4b674-3f30-40d9-bc85-6f23f9ea1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:16.916241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93c4b674-3f30-40d9-bc85-6f23f9ea1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:17.068168 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-93c4b674-3f30-40d9-bc85-6f23f9ea1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:17.076348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-93c4b674-3f30-40d9-bc85-6f23f9ea1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.177672 Dec 15 16:32:17.076922 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 696/1301] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:16 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:18.096214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-879e5ca4-be6d-4cb5-91e1-8b72dabbfb00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:18.097038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-879e5ca4-be6d-4cb5-91e1-8b72dabbfb00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:18.106187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-879e5ca4-be6d-4cb5-91e1-8b72dabbfb00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:18.106773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-879e5ca4-be6d-4cb5-91e1-8b72dabbfb00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:18.108132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-879e5ca4-be6d-4cb5-91e1-8b72dabbfb00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:18.108786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-879e5ca4-be6d-4cb5-91e1-8b72dabbfb00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:18.248451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-879e5ca4-be6d-4cb5-91e1-8b72dabbfb00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:18.256178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-879e5ca4-be6d-4cb5-91e1-8b72dabbfb00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165441 Dec 15 16:32:18.256752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 697/1302] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:19.274197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-edf39938-dc71-45e1-aabe-38cff984454d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:19.274892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-edf39938-dc71-45e1-aabe-38cff984454d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:19.281517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-edf39938-dc71-45e1-aabe-38cff984454d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:19.281960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-edf39938-dc71-45e1-aabe-38cff984454d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:19.282736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-edf39938-dc71-45e1-aabe-38cff984454d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:19.283160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-edf39938-dc71-45e1-aabe-38cff984454d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:19.442073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-edf39938-dc71-45e1-aabe-38cff984454d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:19.450796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-edf39938-dc71-45e1-aabe-38cff984454d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.180445 Dec 15 16:32:19.451360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 698/1303] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:20.469501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7a8cf75c-8f36-4d14-a643-b42f232b2ecf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:20.470222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7a8cf75c-8f36-4d14-a643-b42f232b2ecf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:20.477528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a8cf75c-8f36-4d14-a643-b42f232b2ecf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:20.477969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a8cf75c-8f36-4d14-a643-b42f232b2ecf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:20.478762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a8cf75c-8f36-4d14-a643-b42f232b2ecf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:20.479196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a8cf75c-8f36-4d14-a643-b42f232b2ecf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:20.620715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7a8cf75c-8f36-4d14-a643-b42f232b2ecf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:20.631566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7a8cf75c-8f36-4d14-a643-b42f232b2ecf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.165514 Dec 15 16:32:20.632446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 699/1304] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:20 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:32:21.652523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a89c09a9-13cc-4e93-9012-a9b1c9582cd5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:21.653473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a89c09a9-13cc-4e93-9012-a9b1c9582cd5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:21.662833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a89c09a9-13cc-4e93-9012-a9b1c9582cd5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:21.663605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a89c09a9-13cc-4e93-9012-a9b1c9582cd5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:21.664415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a89c09a9-13cc-4e93-9012-a9b1c9582cd5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:21.664901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a89c09a9-13cc-4e93-9012-a9b1c9582cd5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:21.823006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a89c09a9-13cc-4e93-9012-a9b1c9582cd5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:21.831130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a89c09a9-13cc-4e93-9012-a9b1c9582cd5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.184267 Dec 15 16:32:21.831518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 700/1305] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:22.850915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d4cd6c21-0918-4136-9fbd-8f89f5069be9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:22.851659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d4cd6c21-0918-4136-9fbd-8f89f5069be9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:22.859861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4cd6c21-0918-4136-9fbd-8f89f5069be9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:22.860393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4cd6c21-0918-4136-9fbd-8f89f5069be9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:22.861455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4cd6c21-0918-4136-9fbd-8f89f5069be9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:22.861938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4cd6c21-0918-4136-9fbd-8f89f5069be9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:22.997926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:32:22.998207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:32:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 (ip 10.222.0.30) !!! Dec 15 16:32:23.010750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d4cd6c21-0918-4136-9fbd-8f89f5069be9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:23.022392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d4cd6c21-0918-4136-9fbd-8f89f5069be9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.177033 Dec 15 16:32:23.023329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 701/1306] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:22 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:24.040556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-670061b0-317b-44d6-a8e5-d04163741c96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:24.041234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-670061b0-317b-44d6-a8e5-d04163741c96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:24.047993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-670061b0-317b-44d6-a8e5-d04163741c96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:24.048530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-670061b0-317b-44d6-a8e5-d04163741c96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:24.049282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-670061b0-317b-44d6-a8e5-d04163741c96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:24.049714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-670061b0-317b-44d6-a8e5-d04163741c96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:24.194767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-670061b0-317b-44d6-a8e5-d04163741c96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:24.206202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-670061b0-317b-44d6-a8e5-d04163741c96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.169447 Dec 15 16:32:24.207109 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 702/1307] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:25.227905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1bf2b9a3-431c-4a5e-a42e-9baf5f1c96d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:25.228647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1bf2b9a3-431c-4a5e-a42e-9baf5f1c96d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:25.236196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1bf2b9a3-431c-4a5e-a42e-9baf5f1c96d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:25.236685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1bf2b9a3-431c-4a5e-a42e-9baf5f1c96d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:25.237463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1bf2b9a3-431c-4a5e-a42e-9baf5f1c96d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:25.237890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1bf2b9a3-431c-4a5e-a42e-9baf5f1c96d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:25.370139 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1bf2b9a3-431c-4a5e-a42e-9baf5f1c96d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:25.378979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1bf2b9a3-431c-4a5e-a42e-9baf5f1c96d6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.156840 Dec 15 16:32:25.379469 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 703/1308] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:26.402133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f4e046fe-018e-482b-a58b-5ad5997177c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:26.402957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f4e046fe-018e-482b-a58b-5ad5997177c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:26.409506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f4e046fe-018e-482b-a58b-5ad5997177c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:26.409955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f4e046fe-018e-482b-a58b-5ad5997177c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:26.410744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f4e046fe-018e-482b-a58b-5ad5997177c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:26.411176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f4e046fe-018e-482b-a58b-5ad5997177c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:26.555459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f4e046fe-018e-482b-a58b-5ad5997177c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:26.562990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f4e046fe-018e-482b-a58b-5ad5997177c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.164724 Dec 15 16:32:26.563549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 704/1309] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:26 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:27.583205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d4e1fae6-143d-45a5-a62c-deb612f4fe6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:27.583929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d4e1fae6-143d-45a5-a62c-deb612f4fe6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:27.593083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4e1fae6-143d-45a5-a62c-deb612f4fe6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:27.593536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4e1fae6-143d-45a5-a62c-deb612f4fe6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:27.594333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4e1fae6-143d-45a5-a62c-deb612f4fe6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:27.594764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4e1fae6-143d-45a5-a62c-deb612f4fe6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:27.758146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d4e1fae6-143d-45a5-a62c-deb612f4fe6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:27.770121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d4e1fae6-143d-45a5-a62c-deb612f4fe6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.192427 Dec 15 16:32:27.770955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 705/1310] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:28.793197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9f28653d-701f-429a-a517-b7ee8fed9083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:28.793955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9f28653d-701f-429a-a517-b7ee8fed9083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:28.800939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f28653d-701f-429a-a517-b7ee8fed9083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:28.801383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f28653d-701f-429a-a517-b7ee8fed9083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:28.802161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f28653d-701f-429a-a517-b7ee8fed9083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:28.802601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f28653d-701f-429a-a517-b7ee8fed9083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:28.942276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9f28653d-701f-429a-a517-b7ee8fed9083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:28.950410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9f28653d-701f-429a-a517-b7ee8fed9083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.162228 Dec 15 16:32:28.950948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 706/1311] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:29.974746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a630ef6c-297d-4f7b-a94a-421bffe11ad7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:29.975443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a630ef6c-297d-4f7b-a94a-421bffe11ad7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:29.985047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a630ef6c-297d-4f7b-a94a-421bffe11ad7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:29.985597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a630ef6c-297d-4f7b-a94a-421bffe11ad7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:29.986742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a630ef6c-297d-4f7b-a94a-421bffe11ad7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:29.987366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a630ef6c-297d-4f7b-a94a-421bffe11ad7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:30.143231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a630ef6c-297d-4f7b-a94a-421bffe11ad7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:30.151596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a630ef6c-297d-4f7b-a94a-421bffe11ad7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.182857 Dec 15 16:32:30.152460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 707/1312] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:31.173061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e08e8bd5-840f-4e0b-abcc-aa261b132d61 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:31.173747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e08e8bd5-840f-4e0b-abcc-aa261b132d61 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:31.180331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e08e8bd5-840f-4e0b-abcc-aa261b132d61 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:31.180812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e08e8bd5-840f-4e0b-abcc-aa261b132d61 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:31.181592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e08e8bd5-840f-4e0b-abcc-aa261b132d61 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:31.182007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e08e8bd5-840f-4e0b-abcc-aa261b132d61 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:31.325029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e08e8bd5-840f-4e0b-abcc-aa261b132d61 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:31.336752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e08e8bd5-840f-4e0b-abcc-aa261b132d61 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.168854 Dec 15 16:32:31.337478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 708/1313] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:31 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:32.357151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-798d2c57-1d00-4dcb-81bc-e2126127a872 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:32.357874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-798d2c57-1d00-4dcb-81bc-e2126127a872 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:32.364677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-798d2c57-1d00-4dcb-81bc-e2126127a872 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:32.365123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-798d2c57-1d00-4dcb-81bc-e2126127a872 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:32.365903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-798d2c57-1d00-4dcb-81bc-e2126127a872 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:32.366331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-798d2c57-1d00-4dcb-81bc-e2126127a872 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:32.503367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-798d2c57-1d00-4dcb-81bc-e2126127a872 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:32.511172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-798d2c57-1d00-4dcb-81bc-e2126127a872 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.158111 Dec 15 16:32:32.511717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 709/1314] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:32.759505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:32.759931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:32.767157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:32.768116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:32.768460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:32.768892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:07.725810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-c9558b95-7507-4262-a405-b2ae38e8b383 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lazy-loading 'services' on Instance uuid 96293447-9fd5-4150-abbe-a00f77eb0094 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:33:07.920015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lazy-loading 'services' on Instance uuid 96293447-9fd5-4150-abbe-a00f77eb0094 {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:33:32.860187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c9558b95-7507-4262-a405-b2ae38e8b383 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8" status: 202 len: 0 microversion: 2.1 time: 120.164911 Dec 15 16:33:32.861226 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 606/1315] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Dec 15 16:31:32 2021] DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8 => generated 0 bytes in 120167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:33:32.869043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fdd3e9c4-c323-4526-9302-8d906fa37cb1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:32.869730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fdd3e9c4-c323-4526-9302-8d906fa37cb1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:32.876912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdd3e9c4-c323-4526-9302-8d906fa37cb1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:32.877561 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdd3e9c4-c323-4526-9302-8d906fa37cb1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:32.878901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdd3e9c4-c323-4526-9302-8d906fa37cb1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:32.879346 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdd3e9c4-c323-4526-9302-8d906fa37cb1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:32.883504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e666e83a-0c61-476f-98d9-370721ffadc5) Dec 15 16:33:32.885160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e666e83a-0c61-476f-98d9-370721ffadc5) {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:33:32.886326 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9acb4a87-0f44-4ea4-8cf3-d5381c1be291 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8" status: 400 len: 269 microversion: 2.1 time: 60.130845 Dec 15 16:33:32.888076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 710/1316] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Dec 15 16:32:32 2021] DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8 => generated 269 bytes in 60133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:33:32.894195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f09b4d4c-7328-48bd-906a-e10bde862f46 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:32.895757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f09b4d4c-7328-48bd-906a-e10bde862f46 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:32.903830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f09b4d4c-7328-48bd-906a-e10bde862f46 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:32.904582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f09b4d4c-7328-48bd-906a-e10bde862f46 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:32.906503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f09b4d4c-7328-48bd-906a-e10bde862f46 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:32.907218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f09b4d4c-7328-48bd-906a-e10bde862f46 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:32.944645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f09b4d4c-7328-48bd-906a-e10bde862f46 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054724 Dec 15 16:33:32.948627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 711/1317] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:32.950478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-172347985", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "networks": [{"uuid": "f8e92bdd-a152-4645-9bd2-aa6efe85b650"}]}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:33:33.006902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.network.neutron [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] validate_networks() for [('f8e92bdd-a152-4645-9bd2-aa6efe85b650', None, None, None, None, None)] {{(pid=116021) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:33:33.096380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fdd3e9c4-c323-4526-9302-8d906fa37cb1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:33.104725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fdd3e9c4-c323-4526-9302-8d906fa37cb1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.242336 Dec 15 16:33:33.105301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 607/1318] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:33.110361 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:33.110891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:33.116703 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:33.117158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:33.122477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:33.123034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:33.517488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Flavor limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:33:33.517916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Image limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:33:33.518387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Flavor pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:33:33.518807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Image pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:33:33.519199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:33:33.528410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:33.528889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:33.529702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:33.530136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:33.547568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Getting quotas for project 370dfab4258d483f94f4dc1cbce64954. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:33:33.551446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Getting quotas for user 2a2f7c8ccd2541babbb2eb7503463cd6 and project 370dfab4258d483f94f4dc1cbce64954. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:33:33.562500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Going to run 1 instances... {{(pid=116021) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:33:33.564914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:33:33.611076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-329cfbae-4090-4d97-9009-d2d277c057c0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663714 Dec 15 16:33:33.611846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 712/1319] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:33:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:33:33.621410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0b89219f-5a67-445a-8923-aea1bc93c32c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:33.622076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0b89219f-5a67-445a-8923-aea1bc93c32c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:33.689267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0b89219f-5a67-445a-8923-aea1bc93c32c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:33.697024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0b89219f-5a67-445a-8923-aea1bc93c32c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1217 microversion: 2.1 time: 0.079264 Dec 15 16:33:33.697749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 713/1320] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:33 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:33:33.956952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-30908ca9-8c53-4c10-9496-aa1cc7278b3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:33.958812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-30908ca9-8c53-4c10-9496-aa1cc7278b3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:33.966964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30908ca9-8c53-4c10-9496-aa1cc7278b3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:33.967768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30908ca9-8c53-4c10-9496-aa1cc7278b3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:33.968741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30908ca9-8c53-4c10-9496-aa1cc7278b3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:33.969327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30908ca9-8c53-4c10-9496-aa1cc7278b3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:34.003532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-30908ca9-8c53-4c10-9496-aa1cc7278b3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050352 Dec 15 16:33:34.008289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 714/1321] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:33 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:34.310935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-13da0fe8-5adc-4ef9-bed5-9203ec779c6c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:34.311529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-13da0fe8-5adc-4ef9-bed5-9203ec779c6c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:34.318925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-13da0fe8-5adc-4ef9-bed5-9203ec779c6c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:34.319651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-13da0fe8-5adc-4ef9-bed5-9203ec779c6c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:34.320674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-13da0fe8-5adc-4ef9-bed5-9203ec779c6c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:34.321290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-13da0fe8-5adc-4ef9-bed5-9203ec779c6c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:34.347797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-13da0fe8-5adc-4ef9-bed5-9203ec779c6c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:33:34.434836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-13da0fe8-5adc-4ef9-bed5-9203ec779c6c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 204 len: 0 microversion: 2.1 time: 0.127597 Dec 15 16:33:34.436518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 715/1322] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:33:34 2021] DELETE /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:33:34.502702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-ef1133ea-a352-4024-820e-222445cdce99 req-0855a42d-9297-4af4-b47c-a4eca602bba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4fd848-09ba-42aa-9176-dc8a60b95be2", "tag": "2c61efe0-6ed5-4b49-8a66-8e9f491633d4"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:33:34.504248 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:33:34.504248 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:33:34.512458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-ef1133ea-a352-4024-820e-222445cdce99 req-0855a42d-9297-4af4-b47c-a4eca602bba3 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:34.512918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-ef1133ea-a352-4024-820e-222445cdce99 req-0855a42d-9297-4af4-b47c-a4eca602bba3 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:34.524653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-ef1133ea-a352-4024-820e-222445cdce99 req-0855a42d-9297-4af4-b47c-a4eca602bba3 service nova] Creating event network-changed:2c61efe0-6ed5-4b49-8a66-8e9f491633d4 for instance 4c4fd848-09ba-42aa-9176-dc8a60b95be2 on hv-cinder-82002 Dec 15 16:33:34.529999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-ef1133ea-a352-4024-820e-222445cdce99 req-0855a42d-9297-4af4-b47c-a4eca602bba3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091747 Dec 15 16:33:34.530596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 716/1323] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:33:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:34.535431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4d692332-9435-434f-8955-9f8de9dc6177 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:34.536119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4d692332-9435-434f-8955-9f8de9dc6177 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:34.542698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d692332-9435-434f-8955-9f8de9dc6177 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:34.543159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d692332-9435-434f-8955-9f8de9dc6177 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:34.544332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d692332-9435-434f-8955-9f8de9dc6177 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:34.544921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d692332-9435-434f-8955-9f8de9dc6177 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:34.841037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4d692332-9435-434f-8955-9f8de9dc6177 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:34.851570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4d692332-9435-434f-8955-9f8de9dc6177 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1567 microversion: 2.1 time: 0.319709 Dec 15 16:33:34.854225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 717/1324] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:34 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1567 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:34.867934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0ce75220-0306-4749-bbf1-575a4d8944b7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:34.870061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0ce75220-0306-4749-bbf1-575a4d8944b7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:34.877886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ce75220-0306-4749-bbf1-575a4d8944b7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:34.878471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ce75220-0306-4749-bbf1-575a4d8944b7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:34.879277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ce75220-0306-4749-bbf1-575a4d8944b7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:34.880361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ce75220-0306-4749-bbf1-575a4d8944b7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:34.953890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0ce75220-0306-4749-bbf1-575a4d8944b7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:34.961919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0ce75220-0306-4749-bbf1-575a4d8944b7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1275 microversion: 2.1 time: 0.106593 Dec 15 16:33:34.972147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 718/1325] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:34 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:35.016050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-16479765-d1f4-4979-87f5-702cb018dbe0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:35.017093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-16479765-d1f4-4979-87f5-702cb018dbe0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:35.023856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-16479765-d1f4-4979-87f5-702cb018dbe0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:35.024825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-16479765-d1f4-4979-87f5-702cb018dbe0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:35.025802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-16479765-d1f4-4979-87f5-702cb018dbe0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:35.026230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-16479765-d1f4-4979-87f5-702cb018dbe0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:35.059914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-16479765-d1f4-4979-87f5-702cb018dbe0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047822 Dec 15 16:33:35.060500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 719/1326] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:35.873988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-448554c5-3002-4703-9f8d-f5444573594f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:35.874506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-448554c5-3002-4703-9f8d-f5444573594f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:35.880670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-448554c5-3002-4703-9f8d-f5444573594f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:35.881115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-448554c5-3002-4703-9f8d-f5444573594f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:35.882057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-448554c5-3002-4703-9f8d-f5444573594f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:35.882490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-448554c5-3002-4703-9f8d-f5444573594f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:36.123155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-448554c5-3002-4703-9f8d-f5444573594f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:36.132823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-448554c5-3002-4703-9f8d-f5444573594f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.264966 Dec 15 16:33:36.133482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 720/1327] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:33:36.137865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-61bc30b4-6b97-4e26-a44e-eca7b07c8099 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:36.138466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-61bc30b4-6b97-4e26-a44e-eca7b07c8099 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:36.144503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61bc30b4-6b97-4e26-a44e-eca7b07c8099 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:36.144764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61bc30b4-6b97-4e26-a44e-eca7b07c8099 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:36.145545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61bc30b4-6b97-4e26-a44e-eca7b07c8099 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:36.145976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61bc30b4-6b97-4e26-a44e-eca7b07c8099 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:36.359485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-61bc30b4-6b97-4e26-a44e-eca7b07c8099 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:36.366906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-61bc30b4-6b97-4e26-a44e-eca7b07c8099 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1317 microversion: 2.1 time: 0.232555 Dec 15 16:33:36.367475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 721/1328] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:36 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:36.378719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-30ede824-4781-48cf-a1d0-ab045242eb0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:36.379563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-30ede824-4781-48cf-a1d0-ab045242eb0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:36.385306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30ede824-4781-48cf-a1d0-ab045242eb0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:36.385778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30ede824-4781-48cf-a1d0-ab045242eb0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:36.386750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30ede824-4781-48cf-a1d0-ab045242eb0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:36.387158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-30ede824-4781-48cf-a1d0-ab045242eb0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:36.417396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-30ede824-4781-48cf-a1d0-ab045242eb0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Dec 15 16:33:36.418013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 722/1329] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:36.548669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-aa053414-3189-45f3-884b-f1459182c005 req-070cc043-6d68-4e0c-95f2-ced7fdb80f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a35326-63a8-445f-8588-d8d7c424c441", "tag": "dc256b5e-6441-4373-885f-e17238e5274c"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:33:36.550212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:33:36.550212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:33:36.557267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-aa053414-3189-45f3-884b-f1459182c005 req-070cc043-6d68-4e0c-95f2-ced7fdb80f23 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:36.557702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-aa053414-3189-45f3-884b-f1459182c005 req-070cc043-6d68-4e0c-95f2-ced7fdb80f23 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:36.569162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-aa053414-3189-45f3-884b-f1459182c005 req-070cc043-6d68-4e0c-95f2-ced7fdb80f23 service nova] Creating event network-changed:dc256b5e-6441-4373-885f-e17238e5274c for instance f8a35326-63a8-445f-8588-d8d7c424c441 on hv-cinder-82002 Dec 15 16:33:36.574744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-aa053414-3189-45f3-884b-f1459182c005 req-070cc043-6d68-4e0c-95f2-ced7fdb80f23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090329 Dec 15 16:33:36.575360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 723/1330] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:33:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:33:37.153141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-07c0b176-53f0-422d-98e3-b5d8e6c56887 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:37.153869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-07c0b176-53f0-422d-98e3-b5d8e6c56887 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:37.160881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07c0b176-53f0-422d-98e3-b5d8e6c56887 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:37.161362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07c0b176-53f0-422d-98e3-b5d8e6c56887 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:37.162163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07c0b176-53f0-422d-98e3-b5d8e6c56887 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:37.162692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07c0b176-53f0-422d-98e3-b5d8e6c56887 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:37.400309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-07c0b176-53f0-422d-98e3-b5d8e6c56887 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:37.408981 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-07c0b176-53f0-422d-98e3-b5d8e6c56887 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.261209 Dec 15 16:33:37.409565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 724/1331] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:37 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:37.413994 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1d0be955-fea7-4189-87e5-cbd57882f1a7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:37.414622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1d0be955-fea7-4189-87e5-cbd57882f1a7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:37.420731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d0be955-fea7-4189-87e5-cbd57882f1a7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:37.421177 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d0be955-fea7-4189-87e5-cbd57882f1a7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:37.421970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d0be955-fea7-4189-87e5-cbd57882f1a7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:37.422395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d0be955-fea7-4189-87e5-cbd57882f1a7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:37.707435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1d0be955-fea7-4189-87e5-cbd57882f1a7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:37.718480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1d0be955-fea7-4189-87e5-cbd57882f1a7 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1317 microversion: 2.1 time: 0.307846 Dec 15 16:33:37.719533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 725/1332] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:37 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:37.724878 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2d6d9965-b20c-452e-8961-206cfeb272d1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:37.726634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2d6d9965-b20c-452e-8961-206cfeb272d1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:37.734158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d6d9965-b20c-452e-8961-206cfeb272d1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:37.734815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d6d9965-b20c-452e-8961-206cfeb272d1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:37.735621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d6d9965-b20c-452e-8961-206cfeb272d1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:37.736061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d6d9965-b20c-452e-8961-206cfeb272d1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:37.769727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2d6d9965-b20c-452e-8961-206cfeb272d1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048970 Dec 15 16:33:37.770317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 726/1333] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:38.428308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8421bde4-b101-4437-ae95-052518cfa338 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:38.429051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8421bde4-b101-4437-ae95-052518cfa338 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:38.435600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8421bde4-b101-4437-ae95-052518cfa338 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:38.436052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8421bde4-b101-4437-ae95-052518cfa338 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:38.436880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8421bde4-b101-4437-ae95-052518cfa338 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:38.437312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8421bde4-b101-4437-ae95-052518cfa338 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:38.592608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8421bde4-b101-4437-ae95-052518cfa338 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:38.602163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8421bde4-b101-4437-ae95-052518cfa338 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.177768 Dec 15 16:33:38.602758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 727/1334] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:38.738258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f799118b-ffec-47d7-81e8-573430df4cb9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:38.738783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f799118b-ffec-47d7-81e8-573430df4cb9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:38.745688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f799118b-ffec-47d7-81e8-573430df4cb9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:38.746141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f799118b-ffec-47d7-81e8-573430df4cb9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:38.746935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f799118b-ffec-47d7-81e8-573430df4cb9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:38.747382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f799118b-ffec-47d7-81e8-573430df4cb9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:38.882231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f799118b-ffec-47d7-81e8-573430df4cb9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:38.890633 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f799118b-ffec-47d7-81e8-573430df4cb9 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1317 microversion: 2.1 time: 0.156162 Dec 15 16:33:38.891184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 728/1335] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:38 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:38.895590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-75664f9a-200c-4de2-9c46-41658c382b61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:38.896657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-75664f9a-200c-4de2-9c46-41658c382b61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:38.902893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75664f9a-200c-4de2-9c46-41658c382b61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:38.903368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75664f9a-200c-4de2-9c46-41658c382b61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:38.904278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75664f9a-200c-4de2-9c46-41658c382b61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:38.904756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75664f9a-200c-4de2-9c46-41658c382b61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:38.934330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-75664f9a-200c-4de2-9c46-41658c382b61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042089 Dec 15 16:33:38.935041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 729/1336] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:39.620827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-91c64103-bb99-4f42-a237-737b2c6bdaae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:39.621432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-91c64103-bb99-4f42-a237-737b2c6bdaae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:39.628321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91c64103-bb99-4f42-a237-737b2c6bdaae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:39.628800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91c64103-bb99-4f42-a237-737b2c6bdaae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:39.629582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91c64103-bb99-4f42-a237-737b2c6bdaae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:39.630025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91c64103-bb99-4f42-a237-737b2c6bdaae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:39.781380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-91c64103-bb99-4f42-a237-737b2c6bdaae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:39.789589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-91c64103-bb99-4f42-a237-737b2c6bdaae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.172414 Dec 15 16:33:39.790166 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 730/1337] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:33:39.908394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f78cc9ef-571c-414b-bc2e-491a667c09b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:39.909031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f78cc9ef-571c-414b-bc2e-491a667c09b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:39.915290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f78cc9ef-571c-414b-bc2e-491a667c09b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:39.915688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f78cc9ef-571c-414b-bc2e-491a667c09b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:39.916466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f78cc9ef-571c-414b-bc2e-491a667c09b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:39.916940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f78cc9ef-571c-414b-bc2e-491a667c09b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:40.053082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f78cc9ef-571c-414b-bc2e-491a667c09b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:40.060499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f78cc9ef-571c-414b-bc2e-491a667c09b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1317 microversion: 2.1 time: 0.157097 Dec 15 16:33:40.061064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 731/1338] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:39 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:40.065787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bca134c3-4325-48be-a3cb-7a4c6d94e7e2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:40.066691 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bca134c3-4325-48be-a3cb-7a4c6d94e7e2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:40.072819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bca134c3-4325-48be-a3cb-7a4c6d94e7e2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:40.073263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bca134c3-4325-48be-a3cb-7a4c6d94e7e2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:40.074042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bca134c3-4325-48be-a3cb-7a4c6d94e7e2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:40.074465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bca134c3-4325-48be-a3cb-7a4c6d94e7e2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:40.105237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bca134c3-4325-48be-a3cb-7a4c6d94e7e2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 Dec 15 16:33:40.105802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 732/1339] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:40.810833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2583038d-af17-4243-a658-949af622e3c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:40.811980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2583038d-af17-4243-a658-949af622e3c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:40.818852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2583038d-af17-4243-a658-949af622e3c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:40.819295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2583038d-af17-4243-a658-949af622e3c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:40.820052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2583038d-af17-4243-a658-949af622e3c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:40.820518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2583038d-af17-4243-a658-949af622e3c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:40.980479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2583038d-af17-4243-a658-949af622e3c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:40.988734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2583038d-af17-4243-a658-949af622e3c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.183921 Dec 15 16:33:40.989320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 733/1340] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:40 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:41.079273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6fdc8a6e-a7d7-4ae4-8af3-0b8aa647628a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:41.079780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6fdc8a6e-a7d7-4ae4-8af3-0b8aa647628a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:41.086853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a6e-a7d7-4ae4-8af3-0b8aa647628a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:41.087306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a6e-a7d7-4ae4-8af3-0b8aa647628a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:41.088118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a6e-a7d7-4ae4-8af3-0b8aa647628a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:41.088582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fdc8a6e-a7d7-4ae4-8af3-0b8aa647628a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:41.248725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6fdc8a6e-a7d7-4ae4-8af3-0b8aa647628a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:41.260954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6fdc8a6e-a7d7-4ae4-8af3-0b8aa647628a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1317 microversion: 2.1 time: 0.185537 Dec 15 16:33:41.261894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 734/1341] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:41 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:33:41.267929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ecc0804f-4fd8-4b13-8de1-2eadb97539a8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:41.268871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ecc0804f-4fd8-4b13-8de1-2eadb97539a8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:41.274741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ecc0804f-4fd8-4b13-8de1-2eadb97539a8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:41.275198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ecc0804f-4fd8-4b13-8de1-2eadb97539a8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:41.275990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ecc0804f-4fd8-4b13-8de1-2eadb97539a8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:41.276445 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ecc0804f-4fd8-4b13-8de1-2eadb97539a8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:41.309982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ecc0804f-4fd8-4b13-8de1-2eadb97539a8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046688 Dec 15 16:33:41.310548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 735/1342] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:41.584206 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-ce5a6cfc-bcca-4d39-82d7-31bac07ed17f req-54cf53a6-90ad-4e97-b150-50f233e0c8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a35326-63a8-445f-8588-d8d7c424c441", "name": "network-vif-plugged", "status": "completed", "tag": "dc256b5e-6441-4373-885f-e17238e5274c"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:33:41.585888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:33:41.585888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:33:41.592709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-ce5a6cfc-bcca-4d39-82d7-31bac07ed17f req-54cf53a6-90ad-4e97-b150-50f233e0c8b9 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:41.593426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-ce5a6cfc-bcca-4d39-82d7-31bac07ed17f req-54cf53a6-90ad-4e97-b150-50f233e0c8b9 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:41.604943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-ce5a6cfc-bcca-4d39-82d7-31bac07ed17f req-54cf53a6-90ad-4e97-b150-50f233e0c8b9 service nova] Creating event network-vif-plugged:dc256b5e-6441-4373-885f-e17238e5274c for instance f8a35326-63a8-445f-8588-d8d7c424c441 on hv-cinder-82002 Dec 15 16:33:41.609891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-ce5a6cfc-bcca-4d39-82d7-31bac07ed17f req-54cf53a6-90ad-4e97-b150-50f233e0c8b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080173 Dec 15 16:33:41.610521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 736/1343] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:33:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:42.006786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-24e6dbc5-705f-466f-9caa-ef611103df47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:42.007429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-24e6dbc5-705f-466f-9caa-ef611103df47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:42.014605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24e6dbc5-705f-466f-9caa-ef611103df47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:42.015446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24e6dbc5-705f-466f-9caa-ef611103df47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:42.016256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24e6dbc5-705f-466f-9caa-ef611103df47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:42.016722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24e6dbc5-705f-466f-9caa-ef611103df47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:42.166522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-24e6dbc5-705f-466f-9caa-ef611103df47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:42.174438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-24e6dbc5-705f-466f-9caa-ef611103df47 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.172337 Dec 15 16:33:42.174983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 737/1344] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:42 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:42.283132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5918b142-4441-420f-8ba8-15f9b0db8a9c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:42.283875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5918b142-4441-420f-8ba8-15f9b0db8a9c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:42.292478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5918b142-4441-420f-8ba8-15f9b0db8a9c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:42.292922 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5918b142-4441-420f-8ba8-15f9b0db8a9c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:42.293724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5918b142-4441-420f-8ba8-15f9b0db8a9c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:42.294162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5918b142-4441-420f-8ba8-15f9b0db8a9c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:42.440975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5918b142-4441-420f-8ba8-15f9b0db8a9c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:42.451244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5918b142-4441-420f-8ba8-15f9b0db8a9c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1317 microversion: 2.1 time: 0.174366 Dec 15 16:33:42.451824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 738/1345] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:42 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:42.457500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0936c56a-62b4-4c63-866f-38350be9b1e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:42.458460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0936c56a-62b4-4c63-866f-38350be9b1e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:42.465230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0936c56a-62b4-4c63-866f-38350be9b1e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:42.465672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0936c56a-62b4-4c63-866f-38350be9b1e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:42.466611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0936c56a-62b4-4c63-866f-38350be9b1e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:42.467399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0936c56a-62b4-4c63-866f-38350be9b1e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:42.505091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0936c56a-62b4-4c63-866f-38350be9b1e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052079 Dec 15 16:33:42.505648 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 739/1346] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:43.191992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-60f88b21-cfa9-43b8-99c0-ada404ae499b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:43.192725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-60f88b21-cfa9-43b8-99c0-ada404ae499b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:43.199455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60f88b21-cfa9-43b8-99c0-ada404ae499b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:43.199907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60f88b21-cfa9-43b8-99c0-ada404ae499b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:43.200735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60f88b21-cfa9-43b8-99c0-ada404ae499b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:43.201177 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60f88b21-cfa9-43b8-99c0-ada404ae499b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:43.341933 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-60f88b21-cfa9-43b8-99c0-ada404ae499b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:43.351097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-60f88b21-cfa9-43b8-99c0-ada404ae499b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.163333 Dec 15 16:33:43.351665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 740/1347] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:43 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:43.470616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0eac479c-b8e4-4374-a9a5-c844938f1b39 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:43.471155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0eac479c-b8e4-4374-a9a5-c844938f1b39 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:43.478436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0eac479c-b8e4-4374-a9a5-c844938f1b39 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:43.478914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0eac479c-b8e4-4374-a9a5-c844938f1b39 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:43.479773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0eac479c-b8e4-4374-a9a5-c844938f1b39 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:43.480232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0eac479c-b8e4-4374-a9a5-c844938f1b39 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:43.619213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0eac479c-b8e4-4374-a9a5-c844938f1b39 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:43.627423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0eac479c-b8e4-4374-a9a5-c844938f1b39 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1506 microversion: 2.1 time: 0.160962 Dec 15 16:33:43.627993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 741/1348] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:43 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:43.638219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f1c51f97-7502-4fd5-ae8c-afcaa1d1be9f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:43.639415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f1c51f97-7502-4fd5-ae8c-afcaa1d1be9f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:43.645993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f1c51f97-7502-4fd5-ae8c-afcaa1d1be9f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:43.646438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f1c51f97-7502-4fd5-ae8c-afcaa1d1be9f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:43.647219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f1c51f97-7502-4fd5-ae8c-afcaa1d1be9f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:43.647649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f1c51f97-7502-4fd5-ae8c-afcaa1d1be9f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:43.677623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f1c51f97-7502-4fd5-ae8c-afcaa1d1be9f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043085 Dec 15 16:33:43.678173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 742/1349] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:44.376478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-891a8db7-317c-4b65-bdb0-f0945914b10f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:44.377199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-891a8db7-317c-4b65-bdb0-f0945914b10f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:44.385045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-891a8db7-317c-4b65-bdb0-f0945914b10f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:44.385615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-891a8db7-317c-4b65-bdb0-f0945914b10f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:44.386575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-891a8db7-317c-4b65-bdb0-f0945914b10f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:44.387120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-891a8db7-317c-4b65-bdb0-f0945914b10f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:44.538030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-891a8db7-317c-4b65-bdb0-f0945914b10f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:44.545728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-891a8db7-317c-4b65-bdb0-f0945914b10f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.174919 Dec 15 16:33:44.546530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 743/1350] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:44.691696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f8ac82b3-8d7f-4a8b-8d75-a3214b541b47 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:44.692540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f8ac82b3-8d7f-4a8b-8d75-a3214b541b47 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:44.700995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8ac82b3-8d7f-4a8b-8d75-a3214b541b47 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:44.701623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8ac82b3-8d7f-4a8b-8d75-a3214b541b47 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:44.702696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8ac82b3-8d7f-4a8b-8d75-a3214b541b47 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:44.703129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8ac82b3-8d7f-4a8b-8d75-a3214b541b47 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:44.735219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f8ac82b3-8d7f-4a8b-8d75-a3214b541b47 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048153 Dec 15 16:33:44.735777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 744/1351] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:33:45.568840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7f32db2f-c178-435a-87c0-fb8eeab632d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:45.569539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7f32db2f-c178-435a-87c0-fb8eeab632d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:45.576324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f32db2f-c178-435a-87c0-fb8eeab632d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:45.576798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f32db2f-c178-435a-87c0-fb8eeab632d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:45.577577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f32db2f-c178-435a-87c0-fb8eeab632d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:45.578004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f32db2f-c178-435a-87c0-fb8eeab632d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:45.731869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7f32db2f-c178-435a-87c0-fb8eeab632d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:45.740100 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7f32db2f-c178-435a-87c0-fb8eeab632d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.174986 Dec 15 16:33:45.740739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 745/1352] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:45.746567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-66d0fa50-083e-4366-bf2e-bac27323e13d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:45.747487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-66d0fa50-083e-4366-bf2e-bac27323e13d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:45.753954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66d0fa50-083e-4366-bf2e-bac27323e13d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:45.754416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66d0fa50-083e-4366-bf2e-bac27323e13d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:45.755187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66d0fa50-083e-4366-bf2e-bac27323e13d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:45.755615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66d0fa50-083e-4366-bf2e-bac27323e13d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:45.785614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-66d0fa50-083e-4366-bf2e-bac27323e13d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042595 Dec 15 16:33:45.786164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 746/1353] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:46.757833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cb190dd2-bf6f-4347-aed8-47708932ad99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:46.758604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cb190dd2-bf6f-4347-aed8-47708932ad99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:46.765479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb190dd2-bf6f-4347-aed8-47708932ad99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:46.765926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb190dd2-bf6f-4347-aed8-47708932ad99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:46.766720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb190dd2-bf6f-4347-aed8-47708932ad99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:46.767228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb190dd2-bf6f-4347-aed8-47708932ad99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:46.918388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cb190dd2-bf6f-4347-aed8-47708932ad99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:46.926040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cb190dd2-bf6f-4347-aed8-47708932ad99 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.172083 Dec 15 16:33:46.926614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 747/1354] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:46 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:46.931056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-64c3c7b8-0b9d-4d26-8031-b8f54fc5633b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:46.931984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-64c3c7b8-0b9d-4d26-8031-b8f54fc5633b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:46.938190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64c3c7b8-0b9d-4d26-8031-b8f54fc5633b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:46.938632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64c3c7b8-0b9d-4d26-8031-b8f54fc5633b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:46.939503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64c3c7b8-0b9d-4d26-8031-b8f54fc5633b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:46.939959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64c3c7b8-0b9d-4d26-8031-b8f54fc5633b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:46.969266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-64c3c7b8-0b9d-4d26-8031-b8f54fc5633b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041608 Dec 15 16:33:46.969886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 748/1355] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:47.943577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c9b57e27-e58b-48e8-b7d9-3fa4029a311f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:47.944275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c9b57e27-e58b-48e8-b7d9-3fa4029a311f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:47.951071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9b57e27-e58b-48e8-b7d9-3fa4029a311f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:47.951522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9b57e27-e58b-48e8-b7d9-3fa4029a311f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:47.952344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9b57e27-e58b-48e8-b7d9-3fa4029a311f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:47.952810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9b57e27-e58b-48e8-b7d9-3fa4029a311f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:48.107452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c9b57e27-e58b-48e8-b7d9-3fa4029a311f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:48.117165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c9b57e27-e58b-48e8-b7d9-3fa4029a311f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.177319 Dec 15 16:33:48.117725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 749/1356] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:48.122245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6c7dcb54-7ee8-4500-ad2f-a7e5f8bd7a10 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:48.123381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6c7dcb54-7ee8-4500-ad2f-a7e5f8bd7a10 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:48.129873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c7dcb54-7ee8-4500-ad2f-a7e5f8bd7a10 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:48.130316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c7dcb54-7ee8-4500-ad2f-a7e5f8bd7a10 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:48.131100 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c7dcb54-7ee8-4500-ad2f-a7e5f8bd7a10 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:48.131523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c7dcb54-7ee8-4500-ad2f-a7e5f8bd7a10 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:48.163037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6c7dcb54-7ee8-4500-ad2f-a7e5f8bd7a10 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Dec 15 16:33:48.163584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 750/1357] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:49.138837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5520caee-bfdf-4f97-8689-f38f4e4a7765 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:49.139437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5520caee-bfdf-4f97-8689-f38f4e4a7765 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:49.149161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5520caee-bfdf-4f97-8689-f38f4e4a7765 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:49.149761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5520caee-bfdf-4f97-8689-f38f4e4a7765 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:49.150846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5520caee-bfdf-4f97-8689-f38f4e4a7765 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:49.151290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5520caee-bfdf-4f97-8689-f38f4e4a7765 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:49.301277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5520caee-bfdf-4f97-8689-f38f4e4a7765 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:49.309587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5520caee-bfdf-4f97-8689-f38f4e4a7765 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.176539 Dec 15 16:33:49.310133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 751/1358] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:49 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:49.315116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-10c7165b-be69-4fb5-8b2e-2f826709cd85 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:49.316019 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-10c7165b-be69-4fb5-8b2e-2f826709cd85 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:49.322444 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10c7165b-be69-4fb5-8b2e-2f826709cd85 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:49.323045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10c7165b-be69-4fb5-8b2e-2f826709cd85 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:49.324257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10c7165b-be69-4fb5-8b2e-2f826709cd85 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:49.324907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-10c7165b-be69-4fb5-8b2e-2f826709cd85 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:49.362326 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-10c7165b-be69-4fb5-8b2e-2f826709cd85 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051140 Dec 15 16:33:49.362870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 752/1359] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:50.329217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-40f7bb9e-8522-4843-bbae-88afe126135d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:50.330500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-40f7bb9e-8522-4843-bbae-88afe126135d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:50.339654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40f7bb9e-8522-4843-bbae-88afe126135d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:50.340239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40f7bb9e-8522-4843-bbae-88afe126135d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:50.341494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40f7bb9e-8522-4843-bbae-88afe126135d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:50.342143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40f7bb9e-8522-4843-bbae-88afe126135d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:50.497763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-40f7bb9e-8522-4843-bbae-88afe126135d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:50.505804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-40f7bb9e-8522-4843-bbae-88afe126135d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.180496 Dec 15 16:33:50.506355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 753/1360] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:50 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:50.510676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-50ca3c0b-f009-429f-a74b-357ad1fd05be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:50.511563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-50ca3c0b-f009-429f-a74b-357ad1fd05be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:50.517473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-50ca3c0b-f009-429f-a74b-357ad1fd05be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:50.517930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-50ca3c0b-f009-429f-a74b-357ad1fd05be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:50.518749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-50ca3c0b-f009-429f-a74b-357ad1fd05be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:50.519271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-50ca3c0b-f009-429f-a74b-357ad1fd05be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:50.553241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-50ca3c0b-f009-429f-a74b-357ad1fd05be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045823 Dec 15 16:33:50.553800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 754/1361] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:51.523449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-24644c01-3d8c-4db2-9f91-21addcd0ee1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:51.524152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-24644c01-3d8c-4db2-9f91-21addcd0ee1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:51.530767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24644c01-3d8c-4db2-9f91-21addcd0ee1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:51.531211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24644c01-3d8c-4db2-9f91-21addcd0ee1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:51.531990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24644c01-3d8c-4db2-9f91-21addcd0ee1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:51.532585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24644c01-3d8c-4db2-9f91-21addcd0ee1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:51.676264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-24644c01-3d8c-4db2-9f91-21addcd0ee1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:51.687430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-24644c01-3d8c-4db2-9f91-21addcd0ee1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.167374 Dec 15 16:33:51.688222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 755/1362] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:51.692600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e1bd8a84-bf3c-4f54-8d59-3eb30da35672 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:51.693497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e1bd8a84-bf3c-4f54-8d59-3eb30da35672 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:51.700310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1bd8a84-bf3c-4f54-8d59-3eb30da35672 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:51.701053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1bd8a84-bf3c-4f54-8d59-3eb30da35672 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:51.702600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1bd8a84-bf3c-4f54-8d59-3eb30da35672 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:51.703219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1bd8a84-bf3c-4f54-8d59-3eb30da35672 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:51.736735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e1bd8a84-bf3c-4f54-8d59-3eb30da35672 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047381 Dec 15 16:33:51.737347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 756/1363] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:52.706928 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8f421e8e-4d86-4bd8-83d5-52123d71514d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:52.707626 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8f421e8e-4d86-4bd8-83d5-52123d71514d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:52.714269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8f421e8e-4d86-4bd8-83d5-52123d71514d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:52.714717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8f421e8e-4d86-4bd8-83d5-52123d71514d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:52.715480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8f421e8e-4d86-4bd8-83d5-52123d71514d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:52.715908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8f421e8e-4d86-4bd8-83d5-52123d71514d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:52.853894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8f421e8e-4d86-4bd8-83d5-52123d71514d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:52.861951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8f421e8e-4d86-4bd8-83d5-52123d71514d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.159614 Dec 15 16:33:52.862526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 757/1364] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:52.867458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9e27e107-1625-495f-b951-2a1237add78a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:52.868364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9e27e107-1625-495f-b951-2a1237add78a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:52.874776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e27e107-1625-495f-b951-2a1237add78a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:52.875218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e27e107-1625-495f-b951-2a1237add78a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:52.876103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e27e107-1625-495f-b951-2a1237add78a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:52.876818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e27e107-1625-495f-b951-2a1237add78a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:52.906623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9e27e107-1625-495f-b951-2a1237add78a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043037 Dec 15 16:33:52.907401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 758/1365] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:53.881516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-40593a64-a0be-42ea-9d07-36e75fbef0f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:53.882230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-40593a64-a0be-42ea-9d07-36e75fbef0f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:53.889223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40593a64-a0be-42ea-9d07-36e75fbef0f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:53.889719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40593a64-a0be-42ea-9d07-36e75fbef0f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:53.890497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40593a64-a0be-42ea-9d07-36e75fbef0f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:53.890934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40593a64-a0be-42ea-9d07-36e75fbef0f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:54.046481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-40593a64-a0be-42ea-9d07-36e75fbef0f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:54.054587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-40593a64-a0be-42ea-9d07-36e75fbef0f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.178703 Dec 15 16:33:54.055156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 759/1366] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:53 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:54.059545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bd99a42d-837d-45b8-83f6-a8ffe0a11e97 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:54.060468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bd99a42d-837d-45b8-83f6-a8ffe0a11e97 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:54.067042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd99a42d-837d-45b8-83f6-a8ffe0a11e97 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:54.067492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd99a42d-837d-45b8-83f6-a8ffe0a11e97 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:54.068274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd99a42d-837d-45b8-83f6-a8ffe0a11e97 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:54.068739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd99a42d-837d-45b8-83f6-a8ffe0a11e97 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:54.098694 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bd99a42d-837d-45b8-83f6-a8ffe0a11e97 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Dec 15 16:33:54.099608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 760/1367] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:54 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:55.074304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4fc4d5a1-403c-434f-8866-ee97fcaa2ad5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:55.075001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4fc4d5a1-403c-434f-8866-ee97fcaa2ad5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:55.084655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4fc4d5a1-403c-434f-8866-ee97fcaa2ad5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:55.085323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4fc4d5a1-403c-434f-8866-ee97fcaa2ad5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:55.086523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4fc4d5a1-403c-434f-8866-ee97fcaa2ad5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:55.087263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4fc4d5a1-403c-434f-8866-ee97fcaa2ad5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:55.236175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4fc4d5a1-403c-434f-8866-ee97fcaa2ad5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:55.244198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4fc4d5a1-403c-434f-8866-ee97fcaa2ad5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.175619 Dec 15 16:33:55.244817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 761/1368] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:55.249141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9d44ac66-52c0-4dca-8e60-a6f097da6831 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:55.250064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9d44ac66-52c0-4dca-8e60-a6f097da6831 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:55.256072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9d44ac66-52c0-4dca-8e60-a6f097da6831 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:55.256644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9d44ac66-52c0-4dca-8e60-a6f097da6831 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:55.257422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9d44ac66-52c0-4dca-8e60-a6f097da6831 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:55.257853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9d44ac66-52c0-4dca-8e60-a6f097da6831 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:55.288658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9d44ac66-52c0-4dca-8e60-a6f097da6831 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042776 Dec 15 16:33:55.289224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 762/1369] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:56.265554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cede534b-5058-40a6-8577-af8144fbec17 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:56.266613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cede534b-5058-40a6-8577-af8144fbec17 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:56.277616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cede534b-5058-40a6-8577-af8144fbec17 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:56.278432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cede534b-5058-40a6-8577-af8144fbec17 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:56.279777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cede534b-5058-40a6-8577-af8144fbec17 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:56.280583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cede534b-5058-40a6-8577-af8144fbec17 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:56.424845 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cede534b-5058-40a6-8577-af8144fbec17 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:56.433173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cede534b-5058-40a6-8577-af8144fbec17 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.173930 Dec 15 16:33:56.433753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 763/1370] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:56.438164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7d18a62d-4a88-433e-ba38-b8ba22ce65b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:56.439073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7d18a62d-4a88-433e-ba38-b8ba22ce65b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:56.445217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d18a62d-4a88-433e-ba38-b8ba22ce65b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:56.445666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d18a62d-4a88-433e-ba38-b8ba22ce65b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:56.446483 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d18a62d-4a88-433e-ba38-b8ba22ce65b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:56.446919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d18a62d-4a88-433e-ba38-b8ba22ce65b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:56.479561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7d18a62d-4a88-433e-ba38-b8ba22ce65b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Dec 15 16:33:56.480158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 764/1371] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:57.451499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3a8230c0-437a-4bd1-b726-5ccece2e872d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:57.452163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3a8230c0-437a-4bd1-b726-5ccece2e872d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:57.459036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a8230c0-437a-4bd1-b726-5ccece2e872d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:57.459494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a8230c0-437a-4bd1-b726-5ccece2e872d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:57.460281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a8230c0-437a-4bd1-b726-5ccece2e872d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:57.460732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a8230c0-437a-4bd1-b726-5ccece2e872d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:57.604938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3a8230c0-437a-4bd1-b726-5ccece2e872d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:57.613550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3a8230c0-437a-4bd1-b726-5ccece2e872d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.165879 Dec 15 16:33:57.614135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 765/1372] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:57.618651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a1b20e4b-22e4-46c0-83a1-6db311e95e19 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:57.619548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a1b20e4b-22e4-46c0-83a1-6db311e95e19 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:57.625724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1b20e4b-22e4-46c0-83a1-6db311e95e19 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:57.626362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1b20e4b-22e4-46c0-83a1-6db311e95e19 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:57.627170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1b20e4b-22e4-46c0-83a1-6db311e95e19 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:57.627612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a1b20e4b-22e4-46c0-83a1-6db311e95e19 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:57.658330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a1b20e4b-22e4-46c0-83a1-6db311e95e19 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042934 Dec 15 16:33:57.658923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 766/1373] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:58.632276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-68bdeaf4-85b6-48ca-993e-7c73b55fb6bf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:58.633058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-68bdeaf4-85b6-48ca-993e-7c73b55fb6bf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:58.640228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68bdeaf4-85b6-48ca-993e-7c73b55fb6bf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:58.640723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68bdeaf4-85b6-48ca-993e-7c73b55fb6bf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:58.642081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68bdeaf4-85b6-48ca-993e-7c73b55fb6bf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:58.642227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68bdeaf4-85b6-48ca-993e-7c73b55fb6bf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:58.789620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-68bdeaf4-85b6-48ca-993e-7c73b55fb6bf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:58.798473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-68bdeaf4-85b6-48ca-993e-7c73b55fb6bf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.169736 Dec 15 16:33:58.799057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 767/1374] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:58.803475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-17b6ccda-23fc-4887-a9fe-29ee3d5ec82e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:58.804377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-17b6ccda-23fc-4887-a9fe-29ee3d5ec82e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:58.811095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17b6ccda-23fc-4887-a9fe-29ee3d5ec82e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:58.811543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17b6ccda-23fc-4887-a9fe-29ee3d5ec82e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:58.812381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17b6ccda-23fc-4887-a9fe-29ee3d5ec82e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:58.812839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17b6ccda-23fc-4887-a9fe-29ee3d5ec82e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:58.842330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-17b6ccda-23fc-4887-a9fe-29ee3d5ec82e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042249 Dec 15 16:33:58.842882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 768/1375] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:59.818343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2fb3f585-0c0b-4ba7-8de1-6007a83d914b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:59.819053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2fb3f585-0c0b-4ba7-8de1-6007a83d914b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:59.825330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2fb3f585-0c0b-4ba7-8de1-6007a83d914b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:59.825777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2fb3f585-0c0b-4ba7-8de1-6007a83d914b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:59.826556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2fb3f585-0c0b-4ba7-8de1-6007a83d914b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:59.826994 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2fb3f585-0c0b-4ba7-8de1-6007a83d914b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:59.982254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2fb3f585-0c0b-4ba7-8de1-6007a83d914b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:59.991589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2fb3f585-0c0b-4ba7-8de1-6007a83d914b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.178482 Dec 15 16:33:59.992165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 769/1376] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:59 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:59.996570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e645d17-9b61-45bc-bfbf-468dad2a0c75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:59.997506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1e645d17-9b61-45bc-bfbf-468dad2a0c75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:00.003655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e645d17-9b61-45bc-bfbf-468dad2a0c75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:00.004108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e645d17-9b61-45bc-bfbf-468dad2a0c75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:00.004930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e645d17-9b61-45bc-bfbf-468dad2a0c75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:00.005368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e645d17-9b61-45bc-bfbf-468dad2a0c75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:00.036154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1e645d17-9b61-45bc-bfbf-468dad2a0c75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 Dec 15 16:34:00.037073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 770/1377] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:01.010353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-54d1d0b5-35b4-4ec9-a21e-6264905ccb0b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:01.011034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-54d1d0b5-35b4-4ec9-a21e-6264905ccb0b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:01.017505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-54d1d0b5-35b4-4ec9-a21e-6264905ccb0b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:01.017954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-54d1d0b5-35b4-4ec9-a21e-6264905ccb0b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:01.018731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-54d1d0b5-35b4-4ec9-a21e-6264905ccb0b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:01.019162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-54d1d0b5-35b4-4ec9-a21e-6264905ccb0b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:01.159809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-54d1d0b5-35b4-4ec9-a21e-6264905ccb0b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:01.167182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-54d1d0b5-35b4-4ec9-a21e-6264905ccb0b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.160596 Dec 15 16:34:01.167715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 771/1378] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:01.172394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-35e46e8c-f402-4c5a-8af5-ee7560e11918 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:01.173653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-35e46e8c-f402-4c5a-8af5-ee7560e11918 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:01.179947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35e46e8c-f402-4c5a-8af5-ee7560e11918 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:01.180403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35e46e8c-f402-4c5a-8af5-ee7560e11918 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:01.181213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35e46e8c-f402-4c5a-8af5-ee7560e11918 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:01.181650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35e46e8c-f402-4c5a-8af5-ee7560e11918 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:01.212101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-35e46e8c-f402-4c5a-8af5-ee7560e11918 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043346 Dec 15 16:34:01.212702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 772/1379] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:02.188269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-91fd59ba-19e7-463e-a004-47e1ab17ee7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:02.188965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-91fd59ba-19e7-463e-a004-47e1ab17ee7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:02.196466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91fd59ba-19e7-463e-a004-47e1ab17ee7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:02.196952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91fd59ba-19e7-463e-a004-47e1ab17ee7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:02.197745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91fd59ba-19e7-463e-a004-47e1ab17ee7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:02.198178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91fd59ba-19e7-463e-a004-47e1ab17ee7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:02.346589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-91fd59ba-19e7-463e-a004-47e1ab17ee7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:02.354770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-91fd59ba-19e7-463e-a004-47e1ab17ee7f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.172594 Dec 15 16:34:02.355403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 773/1380] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:02.359649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9e6d84d0-bfda-4f56-aa69-d502806f9b0d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:02.360566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9e6d84d0-bfda-4f56-aa69-d502806f9b0d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:02.366496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e6d84d0-bfda-4f56-aa69-d502806f9b0d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:02.366945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e6d84d0-bfda-4f56-aa69-d502806f9b0d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:02.367726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e6d84d0-bfda-4f56-aa69-d502806f9b0d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:02.368153 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e6d84d0-bfda-4f56-aa69-d502806f9b0d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:02.399098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9e6d84d0-bfda-4f56-aa69-d502806f9b0d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042646 Dec 15 16:34:02.399565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 774/1381] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:03.375461 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8afa4789-868a-4b47-b9c3-a8b7180b0f45 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:03.376180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8afa4789-868a-4b47-b9c3-a8b7180b0f45 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:03.382533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8afa4789-868a-4b47-b9c3-a8b7180b0f45 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:03.382983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8afa4789-868a-4b47-b9c3-a8b7180b0f45 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:03.383921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8afa4789-868a-4b47-b9c3-a8b7180b0f45 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:03.384348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8afa4789-868a-4b47-b9c3-a8b7180b0f45 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:03.531295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8afa4789-868a-4b47-b9c3-a8b7180b0f45 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:03.542276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8afa4789-868a-4b47-b9c3-a8b7180b0f45 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.172218 Dec 15 16:34:03.543207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 775/1382] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:03 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:03.550076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-92b77f12-69b6-4557-a2f0-495b7162f8f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:03.551355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-92b77f12-69b6-4557-a2f0-495b7162f8f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:03.557661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-92b77f12-69b6-4557-a2f0-495b7162f8f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:03.558129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-92b77f12-69b6-4557-a2f0-495b7162f8f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:03.558908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-92b77f12-69b6-4557-a2f0-495b7162f8f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:03.559340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-92b77f12-69b6-4557-a2f0-495b7162f8f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:03.588102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-92b77f12-69b6-4557-a2f0-495b7162f8f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 Dec 15 16:34:03.588678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 776/1383] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:04.563663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-938748f6-4731-49c6-9e15-a2ea9abd1e95 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:04.564374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-938748f6-4731-49c6-9e15-a2ea9abd1e95 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:04.571438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-938748f6-4731-49c6-9e15-a2ea9abd1e95 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:04.571663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-938748f6-4731-49c6-9e15-a2ea9abd1e95 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:04.572725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-938748f6-4731-49c6-9e15-a2ea9abd1e95 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:04.572906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-938748f6-4731-49c6-9e15-a2ea9abd1e95 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:04.715919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-938748f6-4731-49c6-9e15-a2ea9abd1e95 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:04.724548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-938748f6-4731-49c6-9e15-a2ea9abd1e95 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.164808 Dec 15 16:34:04.725109 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 777/1384] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:04.729533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0d0e3307-a983-409b-a7cb-b3f1b25a74ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:04.730427 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0d0e3307-a983-409b-a7cb-b3f1b25a74ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:04.736359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d0e3307-a983-409b-a7cb-b3f1b25a74ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:04.736850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d0e3307-a983-409b-a7cb-b3f1b25a74ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:04.737872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d0e3307-a983-409b-a7cb-b3f1b25a74ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:04.738524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d0e3307-a983-409b-a7cb-b3f1b25a74ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:04.769524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0d0e3307-a983-409b-a7cb-b3f1b25a74ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043248 Dec 15 16:34:04.770087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 778/1385] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:04 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:05.743654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2b24a0fd-bc89-4170-af0f-541fa46953bc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:05.744242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2b24a0fd-bc89-4170-af0f-541fa46953bc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:05.751096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b24a0fd-bc89-4170-af0f-541fa46953bc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:05.751564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b24a0fd-bc89-4170-af0f-541fa46953bc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:05.752348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b24a0fd-bc89-4170-af0f-541fa46953bc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:05.752808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2b24a0fd-bc89-4170-af0f-541fa46953bc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:05.897847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2b24a0fd-bc89-4170-af0f-541fa46953bc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:05.905943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2b24a0fd-bc89-4170-af0f-541fa46953bc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.166049 Dec 15 16:34:05.906743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 779/1386] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:05.911957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a5a3ae76-ef52-4fb7-bdf8-50f4cee73b42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:05.912861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a5a3ae76-ef52-4fb7-bdf8-50f4cee73b42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:05.918904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5a3ae76-ef52-4fb7-bdf8-50f4cee73b42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:05.919372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5a3ae76-ef52-4fb7-bdf8-50f4cee73b42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:05.920153 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5a3ae76-ef52-4fb7-bdf8-50f4cee73b42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:05.920603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5a3ae76-ef52-4fb7-bdf8-50f4cee73b42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:05.951008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a5a3ae76-ef52-4fb7-bdf8-50f4cee73b42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Dec 15 16:34:05.951569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 780/1387] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:06.927445 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ae14aeff-c6e1-4860-b5e2-b0bbccf72528 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:06.928201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ae14aeff-c6e1-4860-b5e2-b0bbccf72528 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:06.935293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae14aeff-c6e1-4860-b5e2-b0bbccf72528 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:06.935784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae14aeff-c6e1-4860-b5e2-b0bbccf72528 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:06.936677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae14aeff-c6e1-4860-b5e2-b0bbccf72528 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:06.937129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae14aeff-c6e1-4860-b5e2-b0bbccf72528 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:07.078497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ae14aeff-c6e1-4860-b5e2-b0bbccf72528 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:07.088945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ae14aeff-c6e1-4860-b5e2-b0bbccf72528 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.165376 Dec 15 16:34:07.089715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 781/1388] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:07.094188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-488f18a3-662f-46d5-97ee-8166893d3df7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:07.095086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-488f18a3-662f-46d5-97ee-8166893d3df7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:07.102066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-662f-46d5-97ee-8166893d3df7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:07.102522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-662f-46d5-97ee-8166893d3df7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:07.103758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-662f-46d5-97ee-8166893d3df7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:07.104360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-488f18a3-662f-46d5-97ee-8166893d3df7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:07.136845 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-488f18a3-662f-46d5-97ee-8166893d3df7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046018 Dec 15 16:34:07.137417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 782/1389] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:08.110358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-73cfadb1-491b-4842-ade9-974e078c5df9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:08.111226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-73cfadb1-491b-4842-ade9-974e078c5df9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:08.120885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73cfadb1-491b-4842-ade9-974e078c5df9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:08.121495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73cfadb1-491b-4842-ade9-974e078c5df9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:08.122585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73cfadb1-491b-4842-ade9-974e078c5df9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:08.123116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73cfadb1-491b-4842-ade9-974e078c5df9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:08.267200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73cfadb1-491b-4842-ade9-974e078c5df9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:08.278402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-73cfadb1-491b-4842-ade9-974e078c5df9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.173914 Dec 15 16:34:08.279120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 783/1390] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:08.285700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-499d89d1-3209-4f64-acb0-b394c1b2bc22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:08.286575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-499d89d1-3209-4f64-acb0-b394c1b2bc22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:08.292707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-499d89d1-3209-4f64-acb0-b394c1b2bc22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:08.293064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-499d89d1-3209-4f64-acb0-b394c1b2bc22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:08.293886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-499d89d1-3209-4f64-acb0-b394c1b2bc22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:08.294309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-499d89d1-3209-4f64-acb0-b394c1b2bc22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:08.337725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-499d89d1-3209-4f64-acb0-b394c1b2bc22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056993 Dec 15 16:34:08.338364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 784/1391] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:09.300213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1d62bb36-9eb4-4c68-90ee-104b89add451 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:09.301788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1d62bb36-9eb4-4c68-90ee-104b89add451 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:09.308893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d62bb36-9eb4-4c68-90ee-104b89add451 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:09.309346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d62bb36-9eb4-4c68-90ee-104b89add451 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:09.310140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d62bb36-9eb4-4c68-90ee-104b89add451 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:09.310570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d62bb36-9eb4-4c68-90ee-104b89add451 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:09.474442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1d62bb36-9eb4-4c68-90ee-104b89add451 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:09.482739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1d62bb36-9eb4-4c68-90ee-104b89add451 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.187995 Dec 15 16:34:09.483570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 785/1392] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:09.488028 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e5dfaa7b-f68c-4448-83ba-528a17e4c45a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:09.489104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5dfaa7b-f68c-4448-83ba-528a17e4c45a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:09.495219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5dfaa7b-f68c-4448-83ba-528a17e4c45a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:09.495668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5dfaa7b-f68c-4448-83ba-528a17e4c45a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:09.496463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5dfaa7b-f68c-4448-83ba-528a17e4c45a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:09.496919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5dfaa7b-f68c-4448-83ba-528a17e4c45a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:09.527700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e5dfaa7b-f68c-4448-83ba-528a17e4c45a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 Dec 15 16:34:09.528253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 786/1393] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:10.501556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-61b69687-7924-4560-9b9d-7e85bad07b15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:10.502245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-61b69687-7924-4560-9b9d-7e85bad07b15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:10.508466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61b69687-7924-4560-9b9d-7e85bad07b15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:10.508930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61b69687-7924-4560-9b9d-7e85bad07b15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:10.509705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61b69687-7924-4560-9b9d-7e85bad07b15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:10.510111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61b69687-7924-4560-9b9d-7e85bad07b15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:10.663007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-61b69687-7924-4560-9b9d-7e85bad07b15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:10.670625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-61b69687-7924-4560-9b9d-7e85bad07b15 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.173188 Dec 15 16:34:10.671257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 787/1394] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:10.676664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7d2ace8d-4dcd-477e-8c65-6f239e04426c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:10.677831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7d2ace8d-4dcd-477e-8c65-6f239e04426c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:10.685909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d2ace8d-4dcd-477e-8c65-6f239e04426c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:10.686400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d2ace8d-4dcd-477e-8c65-6f239e04426c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:10.687197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d2ace8d-4dcd-477e-8c65-6f239e04426c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:10.687633 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d2ace8d-4dcd-477e-8c65-6f239e04426c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:10.724792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7d2ace8d-4dcd-477e-8c65-6f239e04426c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052320 Dec 15 16:34:10.725352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 788/1395] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:11.690801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d5b9a29a-2116-428d-8104-4aea2a0ea7d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:11.697883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d5b9a29a-2116-428d-8104-4aea2a0ea7d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:11.702526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5b9a29a-2116-428d-8104-4aea2a0ea7d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:11.703057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5b9a29a-2116-428d-8104-4aea2a0ea7d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:11.703992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5b9a29a-2116-428d-8104-4aea2a0ea7d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:11.704575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5b9a29a-2116-428d-8104-4aea2a0ea7d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:11.856373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d5b9a29a-2116-428d-8104-4aea2a0ea7d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:11.864851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d5b9a29a-2116-428d-8104-4aea2a0ea7d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.178797 Dec 15 16:34:11.865426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 789/1396] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:11 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:11.869903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0cc02b16-0506-4af5-a3c9-44c59a523f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:11.870803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0cc02b16-0506-4af5-a3c9-44c59a523f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:11.877240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0cc02b16-0506-4af5-a3c9-44c59a523f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:11.877712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0cc02b16-0506-4af5-a3c9-44c59a523f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:11.878491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0cc02b16-0506-4af5-a3c9-44c59a523f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:11.878918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0cc02b16-0506-4af5-a3c9-44c59a523f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:11.908888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0cc02b16-0506-4af5-a3c9-44c59a523f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 Dec 15 16:34:11.909755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 790/1397] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:12.882650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-71751831-61aa-4bed-bb49-1aa97a2ad736 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:12.883357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-71751831-61aa-4bed-bb49-1aa97a2ad736 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:12.889986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71751831-61aa-4bed-bb49-1aa97a2ad736 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:12.890435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71751831-61aa-4bed-bb49-1aa97a2ad736 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:12.891208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71751831-61aa-4bed-bb49-1aa97a2ad736 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:12.891634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71751831-61aa-4bed-bb49-1aa97a2ad736 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:13.028299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-71751831-61aa-4bed-bb49-1aa97a2ad736 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:13.036672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-71751831-61aa-4bed-bb49-1aa97a2ad736 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.157797 Dec 15 16:34:13.037224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 791/1398] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:12 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:13.041630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-434ef461-b02e-4245-a790-d92677a44372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:13.042530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-434ef461-b02e-4245-a790-d92677a44372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:13.048373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-434ef461-b02e-4245-a790-d92677a44372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:13.048855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-434ef461-b02e-4245-a790-d92677a44372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:13.049639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-434ef461-b02e-4245-a790-d92677a44372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:13.050079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-434ef461-b02e-4245-a790-d92677a44372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:13.079658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-434ef461-b02e-4245-a790-d92677a44372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041376 Dec 15 16:34:13.080215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 792/1399] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:13 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:14.054568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fa8915fe-5f99-4445-b0e4-e74d7807bc54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:14.055230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fa8915fe-5f99-4445-b0e4-e74d7807bc54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:14.061796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa8915fe-5f99-4445-b0e4-e74d7807bc54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:14.062273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa8915fe-5f99-4445-b0e4-e74d7807bc54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:14.063037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa8915fe-5f99-4445-b0e4-e74d7807bc54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:14.063500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa8915fe-5f99-4445-b0e4-e74d7807bc54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:14.202964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fa8915fe-5f99-4445-b0e4-e74d7807bc54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:14.214431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fa8915fe-5f99-4445-b0e4-e74d7807bc54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.164189 Dec 15 16:34:14.215009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 793/1400] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:14.220816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-df84c7e6-b9af-4de4-ba72-4e4008efd56b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:14.221725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-df84c7e6-b9af-4de4-ba72-4e4008efd56b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:14.233852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df84c7e6-b9af-4de4-ba72-4e4008efd56b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:14.234299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df84c7e6-b9af-4de4-ba72-4e4008efd56b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:14.235093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df84c7e6-b9af-4de4-ba72-4e4008efd56b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:14.235527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df84c7e6-b9af-4de4-ba72-4e4008efd56b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:14.266432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-df84c7e6-b9af-4de4-ba72-4e4008efd56b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050404 Dec 15 16:34:14.267094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 794/1401] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:14 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:15.234530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0afe3749-9e08-4ac8-83bf-80555950a78c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:15.235263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0afe3749-9e08-4ac8-83bf-80555950a78c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:15.242066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0afe3749-9e08-4ac8-83bf-80555950a78c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:15.242536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0afe3749-9e08-4ac8-83bf-80555950a78c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:15.243318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0afe3749-9e08-4ac8-83bf-80555950a78c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:15.243775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0afe3749-9e08-4ac8-83bf-80555950a78c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:15.397017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0afe3749-9e08-4ac8-83bf-80555950a78c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:15.405254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0afe3749-9e08-4ac8-83bf-80555950a78c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.174511 Dec 15 16:34:15.405825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 795/1402] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:15.410290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-213ea5e7-0fde-482b-8b2a-acb90c3b9045 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:15.411396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-213ea5e7-0fde-482b-8b2a-acb90c3b9045 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:15.416958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-213ea5e7-0fde-482b-8b2a-acb90c3b9045 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:15.417542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-213ea5e7-0fde-482b-8b2a-acb90c3b9045 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:15.418215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-213ea5e7-0fde-482b-8b2a-acb90c3b9045 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:15.418670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-213ea5e7-0fde-482b-8b2a-acb90c3b9045 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:15.448760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-213ea5e7-0fde-482b-8b2a-acb90c3b9045 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Dec 15 16:34:15.449318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 796/1403] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:16.426912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d6de8b61-bbd3-48ea-b4ae-a199ce7191ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:16.427972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d6de8b61-bbd3-48ea-b4ae-a199ce7191ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:16.438171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6de8b61-bbd3-48ea-b4ae-a199ce7191ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:16.438734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6de8b61-bbd3-48ea-b4ae-a199ce7191ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:16.439938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6de8b61-bbd3-48ea-b4ae-a199ce7191ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:16.440533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6de8b61-bbd3-48ea-b4ae-a199ce7191ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:16.580521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d6de8b61-bbd3-48ea-b4ae-a199ce7191ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:16.588805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d6de8b61-bbd3-48ea-b4ae-a199ce7191ba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.168528 Dec 15 16:34:16.589382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 797/1404] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:16 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:16.593810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f3cb29ad-2145-48fe-ba93-56b8995c93b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:16.594714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f3cb29ad-2145-48fe-ba93-56b8995c93b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:16.602510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f3cb29ad-2145-48fe-ba93-56b8995c93b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:16.602955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f3cb29ad-2145-48fe-ba93-56b8995c93b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:16.603753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f3cb29ad-2145-48fe-ba93-56b8995c93b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:16.604172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f3cb29ad-2145-48fe-ba93-56b8995c93b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:16.634538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f3cb29ad-2145-48fe-ba93-56b8995c93b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Dec 15 16:34:16.635098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 798/1405] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:16 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:17.606449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-53211f3e-86b2-4b18-bb16-2cfb96346888 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:17.607198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-53211f3e-86b2-4b18-bb16-2cfb96346888 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:17.613814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53211f3e-86b2-4b18-bb16-2cfb96346888 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:17.614307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53211f3e-86b2-4b18-bb16-2cfb96346888 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:17.615094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53211f3e-86b2-4b18-bb16-2cfb96346888 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:17.615530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-53211f3e-86b2-4b18-bb16-2cfb96346888 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:17.763398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-53211f3e-86b2-4b18-bb16-2cfb96346888 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:17.771298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-53211f3e-86b2-4b18-bb16-2cfb96346888 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.168702 Dec 15 16:34:17.771869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 799/1406] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:17 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:17.776290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1df4af0c-e669-4ef9-aa7f-485bd442ac52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:17.777205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1df4af0c-e669-4ef9-aa7f-485bd442ac52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:17.783184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1df4af0c-e669-4ef9-aa7f-485bd442ac52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:17.783629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1df4af0c-e669-4ef9-aa7f-485bd442ac52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:17.784408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1df4af0c-e669-4ef9-aa7f-485bd442ac52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:17.784876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1df4af0c-e669-4ef9-aa7f-485bd442ac52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:17.814587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1df4af0c-e669-4ef9-aa7f-485bd442ac52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041694 Dec 15 16:34:17.815144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 800/1407] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:18.789611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-680fb3ac-9dbf-42a5-b5ba-3d98ee28ad8c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:18.790372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-680fb3ac-9dbf-42a5-b5ba-3d98ee28ad8c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:18.797902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-680fb3ac-9dbf-42a5-b5ba-3d98ee28ad8c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:18.798386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-680fb3ac-9dbf-42a5-b5ba-3d98ee28ad8c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:18.799243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-680fb3ac-9dbf-42a5-b5ba-3d98ee28ad8c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:18.799723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-680fb3ac-9dbf-42a5-b5ba-3d98ee28ad8c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:18.847475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:34:18.848646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:34:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8 (ip 10.222.0.30) !!! Dec 15 16:34:18.943174 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-680fb3ac-9dbf-42a5-b5ba-3d98ee28ad8c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:18.952596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-680fb3ac-9dbf-42a5-b5ba-3d98ee28ad8c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.167273 Dec 15 16:34:18.953181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 801/1408] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:18.957875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a82e32a0-d2d0-4e8b-bb6a-5f322543414c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:18.958770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a82e32a0-d2d0-4e8b-bb6a-5f322543414c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:18.964719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a82e32a0-d2d0-4e8b-bb6a-5f322543414c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:18.965175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a82e32a0-d2d0-4e8b-bb6a-5f322543414c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:18.965965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a82e32a0-d2d0-4e8b-bb6a-5f322543414c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:18.966404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a82e32a0-d2d0-4e8b-bb6a-5f322543414c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:18.996960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a82e32a0-d2d0-4e8b-bb6a-5f322543414c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042625 Dec 15 16:34:18.997528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 802/1409] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:19.971804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-07e2fd6f-ede0-44ee-8f52-4fc6247ac8dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:19.972513 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-07e2fd6f-ede0-44ee-8f52-4fc6247ac8dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:19.980533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07e2fd6f-ede0-44ee-8f52-4fc6247ac8dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:19.981000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07e2fd6f-ede0-44ee-8f52-4fc6247ac8dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:19.982242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07e2fd6f-ede0-44ee-8f52-4fc6247ac8dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:19.982918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-07e2fd6f-ede0-44ee-8f52-4fc6247ac8dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:20.120391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-07e2fd6f-ede0-44ee-8f52-4fc6247ac8dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:20.128703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-07e2fd6f-ede0-44ee-8f52-4fc6247ac8dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.161572 Dec 15 16:34:20.129275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 803/1410] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:20.133934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-33d87f76-18aa-440d-b7af-17c81323b9ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:20.134830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-33d87f76-18aa-440d-b7af-17c81323b9ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:20.141021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33d87f76-18aa-440d-b7af-17c81323b9ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:20.141496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33d87f76-18aa-440d-b7af-17c81323b9ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:20.142273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33d87f76-18aa-440d-b7af-17c81323b9ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:20.142699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33d87f76-18aa-440d-b7af-17c81323b9ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:20.174078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-33d87f76-18aa-440d-b7af-17c81323b9ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Dec 15 16:34:20.174644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 804/1411] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:20 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:21.147743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e31c4974-f2ec-4348-bbcf-99f41f0fa479 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:21.148384 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e31c4974-f2ec-4348-bbcf-99f41f0fa479 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:21.155275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e31c4974-f2ec-4348-bbcf-99f41f0fa479 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:21.155722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e31c4974-f2ec-4348-bbcf-99f41f0fa479 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:21.156515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e31c4974-f2ec-4348-bbcf-99f41f0fa479 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:21.156944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e31c4974-f2ec-4348-bbcf-99f41f0fa479 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:21.308812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e31c4974-f2ec-4348-bbcf-99f41f0fa479 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:21.322525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e31c4974-f2ec-4348-bbcf-99f41f0fa479 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.178259 Dec 15 16:34:21.324148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 805/1412] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:21.331151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fa523596-8d47-4201-a603-13f34b3c28d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:21.332775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fa523596-8d47-4201-a603-13f34b3c28d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:21.339454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa523596-8d47-4201-a603-13f34b3c28d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:21.339902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa523596-8d47-4201-a603-13f34b3c28d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:21.340737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa523596-8d47-4201-a603-13f34b3c28d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:21.341162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa523596-8d47-4201-a603-13f34b3c28d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:21.375139 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fa523596-8d47-4201-a603-13f34b3c28d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049314 Dec 15 16:34:21.375957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 806/1413] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:22.345479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-23b49884-23d5-40cb-824e-1cd58c55cb5c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:22.346540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-23b49884-23d5-40cb-824e-1cd58c55cb5c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:22.354568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23b49884-23d5-40cb-824e-1cd58c55cb5c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:22.355013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23b49884-23d5-40cb-824e-1cd58c55cb5c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:22.355803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23b49884-23d5-40cb-824e-1cd58c55cb5c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:22.356230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23b49884-23d5-40cb-824e-1cd58c55cb5c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:22.494440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-23b49884-23d5-40cb-824e-1cd58c55cb5c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:22.505804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-23b49884-23d5-40cb-824e-1cd58c55cb5c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.166037 Dec 15 16:34:22.506690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 807/1414] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:22 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:22.510785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-87e67b75-8162-4f46-a2bd-bb84a824517f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:22.511682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-87e67b75-8162-4f46-a2bd-bb84a824517f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:22.517817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-87e67b75-8162-4f46-a2bd-bb84a824517f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:22.518304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-87e67b75-8162-4f46-a2bd-bb84a824517f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:22.519090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-87e67b75-8162-4f46-a2bd-bb84a824517f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:22.519520 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-87e67b75-8162-4f46-a2bd-bb84a824517f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:22.550248 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-87e67b75-8162-4f46-a2bd-bb84a824517f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042843 Dec 15 16:34:22.551031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 808/1415] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:23.523630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d9b01b7f-ec3e-4fb0-a299-6181a5201cba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:23.524349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d9b01b7f-ec3e-4fb0-a299-6181a5201cba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:23.531185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9b01b7f-ec3e-4fb0-a299-6181a5201cba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:23.531870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9b01b7f-ec3e-4fb0-a299-6181a5201cba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:23.532409 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9b01b7f-ec3e-4fb0-a299-6181a5201cba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:23.532869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9b01b7f-ec3e-4fb0-a299-6181a5201cba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:23.696079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d9b01b7f-ec3e-4fb0-a299-6181a5201cba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:23.704395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d9b01b7f-ec3e-4fb0-a299-6181a5201cba tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.184697 Dec 15 16:34:23.705064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 809/1416] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:23 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:23.709689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-05083be4-f27e-4acf-b56e-bfa53cc3e128 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:23.710566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-05083be4-f27e-4acf-b56e-bfa53cc3e128 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:23.716830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05083be4-f27e-4acf-b56e-bfa53cc3e128 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:23.717271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05083be4-f27e-4acf-b56e-bfa53cc3e128 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:23.718050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05083be4-f27e-4acf-b56e-bfa53cc3e128 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:23.718481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-05083be4-f27e-4acf-b56e-bfa53cc3e128 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:23.751190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-05083be4-f27e-4acf-b56e-bfa53cc3e128 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 Dec 15 16:34:23.751774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 810/1417] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:23 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:24.722132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aa609e12-678d-44c6-b697-e4c2a4a9114b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:24.723180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aa609e12-678d-44c6-b697-e4c2a4a9114b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:24.729961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa609e12-678d-44c6-b697-e4c2a4a9114b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:24.730375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa609e12-678d-44c6-b697-e4c2a4a9114b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:24.731189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa609e12-678d-44c6-b697-e4c2a4a9114b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:24.731602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa609e12-678d-44c6-b697-e4c2a4a9114b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:24.885944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-aa609e12-678d-44c6-b697-e4c2a4a9114b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:24.893463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aa609e12-678d-44c6-b697-e4c2a4a9114b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.175202 Dec 15 16:34:24.894036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 811/1418] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:24.898760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1341f0bb-372a-4d26-8549-f3926d4d15e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:24.899667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1341f0bb-372a-4d26-8549-f3926d4d15e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:24.905938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1341f0bb-372a-4d26-8549-f3926d4d15e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:24.906388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1341f0bb-372a-4d26-8549-f3926d4d15e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:24.907182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1341f0bb-372a-4d26-8549-f3926d4d15e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:24.907618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1341f0bb-372a-4d26-8549-f3926d4d15e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:24.937821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1341f0bb-372a-4d26-8549-f3926d4d15e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042709 Dec 15 16:34:24.938381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 812/1419] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:24 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:25.913156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-85b98a9b-68b5-4ce4-a950-08e2dbbbcc23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:25.913877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-85b98a9b-68b5-4ce4-a950-08e2dbbbcc23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:25.923451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85b98a9b-68b5-4ce4-a950-08e2dbbbcc23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:25.923998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85b98a9b-68b5-4ce4-a950-08e2dbbbcc23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:25.925256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85b98a9b-68b5-4ce4-a950-08e2dbbbcc23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:25.925885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85b98a9b-68b5-4ce4-a950-08e2dbbbcc23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:26.068893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-85b98a9b-68b5-4ce4-a950-08e2dbbbcc23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:26.076885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-85b98a9b-68b5-4ce4-a950-08e2dbbbcc23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.169012 Dec 15 16:34:26.077457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 813/1420] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:26.081802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-490beeae-8f36-42b9-bbaf-0af026f84177 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:26.082655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-490beeae-8f36-42b9-bbaf-0af026f84177 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:26.088794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-490beeae-8f36-42b9-bbaf-0af026f84177 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:26.089240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-490beeae-8f36-42b9-bbaf-0af026f84177 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:26.090025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-490beeae-8f36-42b9-bbaf-0af026f84177 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:26.090453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-490beeae-8f36-42b9-bbaf-0af026f84177 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:26.120754 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-490beeae-8f36-42b9-bbaf-0af026f84177 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042227 Dec 15 16:34:26.121287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 814/1421] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:27.095978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4a0583a6-a4a4-40da-91c9-77dca2402c0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:27.096921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4a0583a6-a4a4-40da-91c9-77dca2402c0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:27.105171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4a0583a6-a4a4-40da-91c9-77dca2402c0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:27.105772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4a0583a6-a4a4-40da-91c9-77dca2402c0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:27.106758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4a0583a6-a4a4-40da-91c9-77dca2402c0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:27.107303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4a0583a6-a4a4-40da-91c9-77dca2402c0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:27.250021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4a0583a6-a4a4-40da-91c9-77dca2402c0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:27.261224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4a0583a6-a4a4-40da-91c9-77dca2402c0f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.169670 Dec 15 16:34:27.261997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 815/1422] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:27.266400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-debded6d-b698-49f2-bde6-c66a4f668630 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:27.267300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-debded6d-b698-49f2-bde6-c66a4f668630 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:27.274002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-debded6d-b698-49f2-bde6-c66a4f668630 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:27.274448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-debded6d-b698-49f2-bde6-c66a4f668630 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:27.275235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-debded6d-b698-49f2-bde6-c66a4f668630 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:27.275671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-debded6d-b698-49f2-bde6-c66a4f668630 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:27.305861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-debded6d-b698-49f2-bde6-c66a4f668630 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 Dec 15 16:34:27.306429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 816/1423] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:27 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:28.280532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1224c874-59ee-41aa-a3cb-11ae1fc86e9b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:28.281538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1224c874-59ee-41aa-a3cb-11ae1fc86e9b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:28.290716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1224c874-59ee-41aa-a3cb-11ae1fc86e9b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:28.291159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1224c874-59ee-41aa-a3cb-11ae1fc86e9b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:28.291951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1224c874-59ee-41aa-a3cb-11ae1fc86e9b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:28.292384 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1224c874-59ee-41aa-a3cb-11ae1fc86e9b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:28.450315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1224c874-59ee-41aa-a3cb-11ae1fc86e9b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:28.458015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1224c874-59ee-41aa-a3cb-11ae1fc86e9b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.183358 Dec 15 16:34:28.458557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 817/1424] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:28.463039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ae10cc88-d59e-486a-930c-a68575cdcadc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:28.463919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ae10cc88-d59e-486a-930c-a68575cdcadc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:28.470311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae10cc88-d59e-486a-930c-a68575cdcadc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:28.470743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae10cc88-d59e-486a-930c-a68575cdcadc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:28.471523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae10cc88-d59e-486a-930c-a68575cdcadc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:28.471946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae10cc88-d59e-486a-930c-a68575cdcadc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:28.509886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ae10cc88-d59e-486a-930c-a68575cdcadc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049989 Dec 15 16:34:28.510523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 818/1425] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:29.480320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-96806864-9fff-4fe7-9dfb-eba76e6ba48b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:29.481143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-96806864-9fff-4fe7-9dfb-eba76e6ba48b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:29.490436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96806864-9fff-4fe7-9dfb-eba76e6ba48b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:29.491013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96806864-9fff-4fe7-9dfb-eba76e6ba48b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:29.492146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96806864-9fff-4fe7-9dfb-eba76e6ba48b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:29.492695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96806864-9fff-4fe7-9dfb-eba76e6ba48b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:29.643034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-96806864-9fff-4fe7-9dfb-eba76e6ba48b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:29.652768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-96806864-9fff-4fe7-9dfb-eba76e6ba48b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.179123 Dec 15 16:34:29.653335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 819/1426] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:29.657642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-18052170-eba7-44c7-ba76-96317737cc64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:29.658542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-18052170-eba7-44c7-ba76-96317737cc64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:29.664383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18052170-eba7-44c7-ba76-96317737cc64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:29.664952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18052170-eba7-44c7-ba76-96317737cc64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:29.665717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18052170-eba7-44c7-ba76-96317737cc64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:29.666149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18052170-eba7-44c7-ba76-96317737cc64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:29.697140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-18052170-eba7-44c7-ba76-96317737cc64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042749 Dec 15 16:34:29.697735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 820/1427] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:30.670515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1c641684-ee38-4b5e-9e77-f0158fe4af32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:30.671236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1c641684-ee38-4b5e-9e77-f0158fe4af32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:30.677871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c641684-ee38-4b5e-9e77-f0158fe4af32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:30.678317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c641684-ee38-4b5e-9e77-f0158fe4af32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:30.679097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c641684-ee38-4b5e-9e77-f0158fe4af32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:30.679523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c641684-ee38-4b5e-9e77-f0158fe4af32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:30.820881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1c641684-ee38-4b5e-9e77-f0158fe4af32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:30.833212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1c641684-ee38-4b5e-9e77-f0158fe4af32 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.166227 Dec 15 16:34:30.833977 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 821/1428] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:30 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:30.839533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-efa7aabb-0951-40c4-bde8-e30aae68511d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:30.840444 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-efa7aabb-0951-40c4-bde8-e30aae68511d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:30.846757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-efa7aabb-0951-40c4-bde8-e30aae68511d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:30.847562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-efa7aabb-0951-40c4-bde8-e30aae68511d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:30.848345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-efa7aabb-0951-40c4-bde8-e30aae68511d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:30.848813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-efa7aabb-0951-40c4-bde8-e30aae68511d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:30.884589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-efa7aabb-0951-40c4-bde8-e30aae68511d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049376 Dec 15 16:34:30.885158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 822/1429] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:31.855036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-86b89331-3672-4885-8604-46894acc6247 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:31.855748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-86b89331-3672-4885-8604-46894acc6247 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:31.862490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86b89331-3672-4885-8604-46894acc6247 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:31.862934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86b89331-3672-4885-8604-46894acc6247 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:31.863713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86b89331-3672-4885-8604-46894acc6247 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:31.864141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86b89331-3672-4885-8604-46894acc6247 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:32.010799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-86b89331-3672-4885-8604-46894acc6247 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:34:32.018896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-86b89331-3672-4885-8604-46894acc6247 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.169637 Dec 15 16:34:32.019438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 823/1430] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:34:31 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:34:32.023869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-17d3ea6c-ce52-4ca6-92aa-63a93425c2e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:32.024814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-17d3ea6c-ce52-4ca6-92aa-63a93425c2e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:32.031263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17d3ea6c-ce52-4ca6-92aa-63a93425c2e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:32.031703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17d3ea6c-ce52-4ca6-92aa-63a93425c2e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:32.032521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17d3ea6c-ce52-4ca6-92aa-63a93425c2e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:32.032954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17d3ea6c-ce52-4ca6-92aa-63a93425c2e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:32.063000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-17d3ea6c-ce52-4ca6-92aa-63a93425c2e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 Dec 15 16:34:32.063542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 824/1431] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:34:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:34:32.949989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:34:32.950641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:34:32.956731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:32.957171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:32.957947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:34:32.958369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:34:39.177887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:34:39.178444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:34:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8 (ip 10.222.0.30) !!! Dec 15 16:35:08.225176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lazy-loading 'services' on Instance uuid 96293447-9fd5-4150-abbe-a00f77eb0094 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:35:08.544979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lazy-loading 'services' on Instance uuid 96293447-9fd5-4150-abbe-a00f77eb0094 {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:35:33.088291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-708d1a40-8699-4ab1-9265-1467f8f94d3a) Dec 15 16:35:33.088944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-708d1a40-8699-4ab1-9265-1467f8f94d3a) {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:35:33.089836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d4b51729-a6e7-4e81-be28-f4963b42c273 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8" status: 400 len: 269 microversion: 2.1 time: 119.983294 Dec 15 16:35:33.090682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 608/1432] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Dec 15 16:33:33 2021] DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8 => generated 269 bytes in 119985 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:35:33.095943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-028e9768-8b61-4446-9099-229b814e2bc5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:33.096584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-028e9768-8b61-4446-9099-229b814e2bc5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:33.104972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-028e9768-8b61-4446-9099-229b814e2bc5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.105398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-028e9768-8b61-4446-9099-229b814e2bc5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.106217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-028e9768-8b61-4446-9099-229b814e2bc5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.106618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-028e9768-8b61-4446-9099-229b814e2bc5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.130804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8822c61-132f-4b15-926e-d060482ed39d) Dec 15 16:35:33.131559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8822c61-132f-4b15-926e-d060482ed39d) {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:35:33.132693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a829de40-20a8-4012-8518-bd54af5aa03f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8" status: 400 len: 269 microversion: 2.1 time: 60.255689 Dec 15 16:35:33.133593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 825/1433] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Dec 15 16:34:32 2021] DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8 => generated 269 bytes in 60258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:35:33.140495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3cbb60eb-becc-4861-b1c2-c56ad3e54835 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:33.141561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3cbb60eb-becc-4861-b1c2-c56ad3e54835 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:33.149077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cbb60eb-becc-4861-b1c2-c56ad3e54835 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.149937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cbb60eb-becc-4861-b1c2-c56ad3e54835 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.151250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cbb60eb-becc-4861-b1c2-c56ad3e54835 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.151719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3cbb60eb-becc-4861-b1c2-c56ad3e54835 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.182716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3cbb60eb-becc-4861-b1c2-c56ad3e54835 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047646 Dec 15 16:35:33.183289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 826/1434] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:33 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:33.187955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1451354734", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "networks": [{"uuid": "f8e92bdd-a152-4645-9bd2-aa6efe85b650"}]}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:35:33.250620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.network.neutron [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] validate_networks() for [('f8e92bdd-a152-4645-9bd2-aa6efe85b650', None, None, None, None, None)] {{(pid=116021) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:35:33.278340 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-028e9768-8b61-4446-9099-229b814e2bc5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:33.285942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-028e9768-8b61-4446-9099-229b814e2bc5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.194382 Dec 15 16:35:33.286534 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 609/1435] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:33.291296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:33.291784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:33.297568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.298037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.298821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.299275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.379442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lazy-loading 'services' on Instance uuid 96293447-9fd5-4150-abbe-a00f77eb0094 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:35:33.433320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0aac5473-d4bf-41e8-939e-e41013ed9d7c) Dec 15 16:35:33.434647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0aac5473-d4bf-41e8-939e-e41013ed9d7c) {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:35:33.435950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9e846f84-0551-4e23-8fa4-b521d46d8967 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8" status: 400 len: 269 microversion: 2.1 time: 0.148522 Dec 15 16:35:33.436721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 610/1436] 10.222.0.30 () {58 vars in 1415 bytes} [Wed Dec 15 16:35:33 2021] DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094/os-volume_attachments/aacb9a93-93b1-4b27-8b9e-9b044052d5e8 => generated 269 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:35:33.441809 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cfc97b0d-88a2-4ab3-aa50-753bab235d4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:33.443188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cfc97b0d-88a2-4ab3-aa50-753bab235d4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:33.450671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cfc97b0d-88a2-4ab3-aa50-753bab235d4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.451116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cfc97b0d-88a2-4ab3-aa50-753bab235d4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.452107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cfc97b0d-88a2-4ab3-aa50-753bab235d4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.452567 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cfc97b0d-88a2-4ab3-aa50-753bab235d4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.687119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cfc97b0d-88a2-4ab3-aa50-753bab235d4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:33.694655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cfc97b0d-88a2-4ab3-aa50-753bab235d4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.256556 Dec 15 16:35:33.695205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 611/1437] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:33.702271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-31bf9576-cd72-42b6-9902-c02fedbdd8f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:33.703542 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-31bf9576-cd72-42b6-9902-c02fedbdd8f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:33.709375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31bf9576-cd72-42b6-9902-c02fedbdd8f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.709817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31bf9576-cd72-42b6-9902-c02fedbdd8f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.710605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31bf9576-cd72-42b6-9902-c02fedbdd8f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.711443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31bf9576-cd72-42b6-9902-c02fedbdd8f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.717009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Flavor limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:35:33.717565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Image limits 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:35:33.718129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Flavor pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:35:33.718601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Image pref 0:0:0 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:35:33.719092 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.virt.hardware [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:35:33.728817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.729260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.731082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:33.731082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:33.742344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-31bf9576-cd72-42b6-9902-c02fedbdd8f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Dec 15 16:35:33.742927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 612/1438] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:33 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:33.749356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Getting quotas for project 370dfab4258d483f94f4dc1cbce64954. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:35:33.753354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Getting quotas for user 2a2f7c8ccd2541babbb2eb7503463cd6 and project 370dfab4258d483f94f4dc1cbce64954. Resources: {'cores', 'ram', 'instances'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:35:33.764242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Going to run 1 instances... {{(pid=116021) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:35:33.766629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:35:33.815450 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2d10852c-7988-4e01-9e8f-2bdc43cf6ee6 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630799 Dec 15 16:35:33.816201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 827/1439] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:35:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:35:33.826730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-68d02fc9-9719-4464-9e59-fbb6a285356b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:33.827347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-68d02fc9-9719-4464-9e59-fbb6a285356b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:33.886359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-68d02fc9-9719-4464-9e59-fbb6a285356b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:33.893140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-68d02fc9-9719-4464-9e59-fbb6a285356b tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1218 microversion: 2.1 time: 0.070081 Dec 15 16:35:33.893720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 613/1440] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:33 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:34.715773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-44fe4d11-c3ca-4de6-a835-863cfb17ce42 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:34.716476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-44fe4d11-c3ca-4de6-a835-863cfb17ce42 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:34.723405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44fe4d11-c3ca-4de6-a835-863cfb17ce42 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:34.724473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44fe4d11-c3ca-4de6-a835-863cfb17ce42 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:34.725272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44fe4d11-c3ca-4de6-a835-863cfb17ce42 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:34.725702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44fe4d11-c3ca-4de6-a835-863cfb17ce42 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:34.753818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-042ba42d-978d-494d-987b-3b99a2de2ca9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:34.755511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-042ba42d-978d-494d-987b-3b99a2de2ca9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:34.762944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-042ba42d-978d-494d-987b-3b99a2de2ca9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:34.763384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-042ba42d-978d-494d-987b-3b99a2de2ca9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:34.764169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-042ba42d-978d-494d-987b-3b99a2de2ca9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:34.764627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-042ba42d-978d-494d-987b-3b99a2de2ca9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:34.801764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-042ba42d-978d-494d-987b-3b99a2de2ca9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051690 Dec 15 16:35:34.802665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 614/1441] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:34.914496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ff17d689-dda0-4364-8be6-83551b8fd296 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:34.921256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ff17d689-dda0-4364-8be6-83551b8fd296 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:34.928318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff17d689-dda0-4364-8be6-83551b8fd296 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:34.928884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff17d689-dda0-4364-8be6-83551b8fd296 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:34.929793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff17d689-dda0-4364-8be6-83551b8fd296 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:34.930799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff17d689-dda0-4364-8be6-83551b8fd296 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:34.952121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-44fe4d11-c3ca-4de6-a835-863cfb17ce42 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:34.961221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-44fe4d11-c3ca-4de6-a835-863cfb17ce42 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.252675 Dec 15 16:35:34.964762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 828/1442] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:34 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:35.002585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ff17d689-dda0-4364-8be6-83551b8fd296 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:35.013106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ff17d689-dda0-4364-8be6-83551b8fd296 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1276 microversion: 2.1 time: 0.102426 Dec 15 16:35:35.013690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 615/1443] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:34 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:35.813646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-423f7038-d4e2-491b-b77b-73155aaae87f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:35.814615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-423f7038-d4e2-491b-b77b-73155aaae87f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:35.821632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-423f7038-d4e2-491b-b77b-73155aaae87f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:35.822086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-423f7038-d4e2-491b-b77b-73155aaae87f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:35.822879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-423f7038-d4e2-491b-b77b-73155aaae87f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:35.823307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-423f7038-d4e2-491b-b77b-73155aaae87f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:35.856547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-423f7038-d4e2-491b-b77b-73155aaae87f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046568 Dec 15 16:35:35.857185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 829/1444] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:35.979555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b06fea13-1946-4d46-82fd-b68486bf8598 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:35.980314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b06fea13-1946-4d46-82fd-b68486bf8598 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:35.987627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b06fea13-1946-4d46-82fd-b68486bf8598 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:35.988072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b06fea13-1946-4d46-82fd-b68486bf8598 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:35.988998 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b06fea13-1946-4d46-82fd-b68486bf8598 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:35.989439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b06fea13-1946-4d46-82fd-b68486bf8598 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:36.030816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e873d6a-aa1d-4104-8c82-1d8c2b2c345e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:36.031470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1e873d6a-aa1d-4104-8c82-1d8c2b2c345e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:36.038339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e873d6a-aa1d-4104-8c82-1d8c2b2c345e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:36.038707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e873d6a-aa1d-4104-8c82-1d8c2b2c345e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:36.040219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e873d6a-aa1d-4104-8c82-1d8c2b2c345e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:36.040691 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e873d6a-aa1d-4104-8c82-1d8c2b2c345e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:36.362953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1e873d6a-aa1d-4104-8c82-1d8c2b2c345e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:36.370313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1e873d6a-aa1d-4104-8c82-1d8c2b2c345e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1318 microversion: 2.1 time: 0.343342 Dec 15 16:35:36.370909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 830/1445] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:36 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:36.375711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b06fea13-1946-4d46-82fd-b68486bf8598 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:36.384535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b06fea13-1946-4d46-82fd-b68486bf8598 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.408871 Dec 15 16:35:36.385329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 616/1446] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:36.637725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-b3d6aad4-010e-4750-ad02-62eda8b808eb req-1f77c77f-ea86-4cdd-998b-84b1bf520ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eaeeee0-0df6-446b-86cb-5048272ae551", "tag": "9d0d6033-d810-4f90-92fa-b1c3f8ebe691"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:35:36.639334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:35:36.639334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:35:36.646958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-b3d6aad4-010e-4750-ad02-62eda8b808eb req-1f77c77f-ea86-4cdd-998b-84b1bf520ee8 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:36.647395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-b3d6aad4-010e-4750-ad02-62eda8b808eb req-1f77c77f-ea86-4cdd-998b-84b1bf520ee8 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:36.667968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-b3d6aad4-010e-4750-ad02-62eda8b808eb req-1f77c77f-ea86-4cdd-998b-84b1bf520ee8 service nova] Creating event network-changed:9d0d6033-d810-4f90-92fa-b1c3f8ebe691 for instance 6eaeeee0-0df6-446b-86cb-5048272ae551 on hv-cinder-82002 Dec 15 16:35:36.673163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-b3d6aad4-010e-4750-ad02-62eda8b808eb req-1f77c77f-ea86-4cdd-998b-84b1bf520ee8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039345 Dec 15 16:35:36.673792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 831/1447] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:35:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:35:36.869469 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f7b1f14d-453f-4b00-82c5-d731d68485bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:36.870411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f7b1f14d-453f-4b00-82c5-d731d68485bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:36.876988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7b1f14d-453f-4b00-82c5-d731d68485bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:36.877435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7b1f14d-453f-4b00-82c5-d731d68485bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:36.878221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7b1f14d-453f-4b00-82c5-d731d68485bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:36.878654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7b1f14d-453f-4b00-82c5-d731d68485bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:36.909302 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f7b1f14d-453f-4b00-82c5-d731d68485bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044066 Dec 15 16:35:36.909884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 617/1448] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:37.390957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7a3c4493-e1c9-4489-96f9-dac502ecbf04 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:37.392021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7a3c4493-e1c9-4489-96f9-dac502ecbf04 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:37.399719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a3c4493-e1c9-4489-96f9-dac502ecbf04 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:37.400240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a3c4493-e1c9-4489-96f9-dac502ecbf04 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:37.401113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a3c4493-e1c9-4489-96f9-dac502ecbf04 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:37.401553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a3c4493-e1c9-4489-96f9-dac502ecbf04 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:37.404743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-36bff9aa-4ffe-4182-8532-5df7067f157e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:37.405721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-36bff9aa-4ffe-4182-8532-5df7067f157e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:37.412920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36bff9aa-4ffe-4182-8532-5df7067f157e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:37.413368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36bff9aa-4ffe-4182-8532-5df7067f157e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:37.414131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36bff9aa-4ffe-4182-8532-5df7067f157e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:37.414729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-36bff9aa-4ffe-4182-8532-5df7067f157e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:37.681890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7a3c4493-e1c9-4489-96f9-dac502ecbf04 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:37.689524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7a3c4493-e1c9-4489-96f9-dac502ecbf04 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1318 microversion: 2.1 time: 0.304763 Dec 15 16:35:37.690086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 832/1449] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:37 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:37.704610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-36bff9aa-4ffe-4182-8532-5df7067f157e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:37.712856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-36bff9aa-4ffe-4182-8532-5df7067f157e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.314185 Dec 15 16:35:37.713477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 618/1450] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:37 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:37.921725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0f4eb253-6a86-4ad1-ad51-711cf7e961f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:37.922642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0f4eb253-6a86-4ad1-ad51-711cf7e961f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:37.929186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f4eb253-6a86-4ad1-ad51-711cf7e961f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:37.929568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f4eb253-6a86-4ad1-ad51-711cf7e961f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:37.930356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f4eb253-6a86-4ad1-ad51-711cf7e961f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:37.931323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f4eb253-6a86-4ad1-ad51-711cf7e961f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:37.961587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0f4eb253-6a86-4ad1-ad51-711cf7e961f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Dec 15 16:35:37.962384 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 833/1451] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:38.707863 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bd763290-f86b-4f79-aa70-7cc38835d568 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:38.708616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bd763290-f86b-4f79-aa70-7cc38835d568 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:38.718026 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd763290-f86b-4f79-aa70-7cc38835d568 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:38.718531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd763290-f86b-4f79-aa70-7cc38835d568 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:38.720099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd763290-f86b-4f79-aa70-7cc38835d568 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:38.720852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd763290-f86b-4f79-aa70-7cc38835d568 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:38.732448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b154913f-4c5f-4792-9abe-f5195de9cd46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:38.733242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b154913f-4c5f-4792-9abe-f5195de9cd46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:38.743236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b154913f-4c5f-4792-9abe-f5195de9cd46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:38.743959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b154913f-4c5f-4792-9abe-f5195de9cd46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:38.745288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b154913f-4c5f-4792-9abe-f5195de9cd46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:38.745886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b154913f-4c5f-4792-9abe-f5195de9cd46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:38.940543 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bd763290-f86b-4f79-aa70-7cc38835d568 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:38.950582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bd763290-f86b-4f79-aa70-7cc38835d568 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1318 microversion: 2.1 time: 0.246510 Dec 15 16:35:38.951194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 619/1452] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:38 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:38.956060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b154913f-4c5f-4792-9abe-f5195de9cd46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:38.969750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b154913f-4c5f-4792-9abe-f5195de9cd46 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.240318 Dec 15 16:35:38.970672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 834/1453] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:38.973574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-53cb2ea2-a694-4314-91fa-4b7cb14a7b43 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:38.974495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-53cb2ea2-a694-4314-91fa-4b7cb14a7b43 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:38.981451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53cb2ea2-a694-4314-91fa-4b7cb14a7b43 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:38.981900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53cb2ea2-a694-4314-91fa-4b7cb14a7b43 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:38.992188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53cb2ea2-a694-4314-91fa-4b7cb14a7b43 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:38.992664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53cb2ea2-a694-4314-91fa-4b7cb14a7b43 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:39.035120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-53cb2ea2-a694-4314-91fa-4b7cb14a7b43 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065060 Dec 15 16:35:39.035663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 620/1454] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:39.971525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5557f568-45c1-487b-a949-f958e49c1711 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:39.972096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5557f568-45c1-487b-a949-f958e49c1711 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:39.978930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5557f568-45c1-487b-a949-f958e49c1711 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:39.979370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5557f568-45c1-487b-a949-f958e49c1711 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:39.980143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5557f568-45c1-487b-a949-f958e49c1711 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:39.980601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5557f568-45c1-487b-a949-f958e49c1711 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:39.991018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bc17fd60-428c-4662-bbbf-7ae3ef94ea54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:39.991590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bc17fd60-428c-4662-bbbf-7ae3ef94ea54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:39.998344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc17fd60-428c-4662-bbbf-7ae3ef94ea54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:39.998796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc17fd60-428c-4662-bbbf-7ae3ef94ea54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:39.999596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc17fd60-428c-4662-bbbf-7ae3ef94ea54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:40.000029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bc17fd60-428c-4662-bbbf-7ae3ef94ea54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:40.186438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5557f568-45c1-487b-a949-f958e49c1711 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:40.189922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bc17fd60-428c-4662-bbbf-7ae3ef94ea54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:40.194991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5557f568-45c1-487b-a949-f958e49c1711 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1318 microversion: 2.1 time: 0.227438 Dec 15 16:35:40.195807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 835/1455] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:39 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:40.200322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bea9e548-553b-49ff-89c0-4b6dd58f4fad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:40.201257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bea9e548-553b-49ff-89c0-4b6dd58f4fad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:40.207119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bea9e548-553b-49ff-89c0-4b6dd58f4fad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:40.207561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bea9e548-553b-49ff-89c0-4b6dd58f4fad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:40.208134 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bc17fd60-428c-4662-bbbf-7ae3ef94ea54 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.220750 Dec 15 16:35:40.208335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bea9e548-553b-49ff-89c0-4b6dd58f4fad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:40.208822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 621/1456] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:40.208943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bea9e548-553b-49ff-89c0-4b6dd58f4fad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:40.239030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bea9e548-553b-49ff-89c0-4b6dd58f4fad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042367 Dec 15 16:35:40.239602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 836/1457] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:41.214061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1e19bc29-a584-4dd9-8058-6ca6087368a4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:41.214624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1e19bc29-a584-4dd9-8058-6ca6087368a4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:41.221692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e19bc29-a584-4dd9-8058-6ca6087368a4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:41.222133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e19bc29-a584-4dd9-8058-6ca6087368a4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:41.222912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e19bc29-a584-4dd9-8058-6ca6087368a4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:41.223341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e19bc29-a584-4dd9-8058-6ca6087368a4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:41.230584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d86728d3-6351-4388-87a5-99af91eaf759 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:41.231202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d86728d3-6351-4388-87a5-99af91eaf759 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:41.237903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d86728d3-6351-4388-87a5-99af91eaf759 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:41.238354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d86728d3-6351-4388-87a5-99af91eaf759 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:41.239142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d86728d3-6351-4388-87a5-99af91eaf759 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:41.239571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d86728d3-6351-4388-87a5-99af91eaf759 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:41.423881 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1e19bc29-a584-4dd9-8058-6ca6087368a4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:41.429229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d86728d3-6351-4388-87a5-99af91eaf759 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:41.434540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1e19bc29-a584-4dd9-8058-6ca6087368a4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1318 microversion: 2.1 time: 0.225202 Dec 15 16:35:41.435117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 622/1458] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:41 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:41.438295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d86728d3-6351-4388-87a5-99af91eaf759 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.211617 Dec 15 16:35:41.439309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 837/1459] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:41 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:41.439727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-57e185d4-edb2-40e4-8f94-2f948ba2a397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:41.440699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-57e185d4-edb2-40e4-8f94-2f948ba2a397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:41.446958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57e185d4-edb2-40e4-8f94-2f948ba2a397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:41.447470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57e185d4-edb2-40e4-8f94-2f948ba2a397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:41.448405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57e185d4-edb2-40e4-8f94-2f948ba2a397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:41.448881 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57e185d4-edb2-40e4-8f94-2f948ba2a397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:41.479360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-57e185d4-edb2-40e4-8f94-2f948ba2a397 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 Dec 15 16:35:41.479910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 623/1460] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:42.123976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-c0774686-769f-41c8-ab83-e82bd8234ae1 req-efbee966-7eb9-4f1f-a499-038c69172a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eaeeee0-0df6-446b-86cb-5048272ae551", "name": "network-vif-plugged", "status": "completed", "tag": "9d0d6033-d810-4f90-92fa-b1c3f8ebe691"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:35:42.125186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:35:42.125186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:35:42.133621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-c0774686-769f-41c8-ab83-e82bd8234ae1 req-efbee966-7eb9-4f1f-a499-038c69172a56 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:42.134131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-c0774686-769f-41c8-ab83-e82bd8234ae1 req-efbee966-7eb9-4f1f-a499-038c69172a56 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:42.147703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-c0774686-769f-41c8-ab83-e82bd8234ae1 req-efbee966-7eb9-4f1f-a499-038c69172a56 service nova] Creating event network-vif-plugged:9d0d6033-d810-4f90-92fa-b1c3f8ebe691 for instance 6eaeeee0-0df6-446b-86cb-5048272ae551 on hv-cinder-82002 Dec 15 16:35:42.152842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-c0774686-769f-41c8-ab83-e82bd8234ae1 req-efbee966-7eb9-4f1f-a499-038c69172a56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034197 Dec 15 16:35:42.153442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 838/1461] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:35:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:42.454524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aeea8adf-a287-4397-a3a3-1220da9cb5b4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:42.455131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aeea8adf-a287-4397-a3a3-1220da9cb5b4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:42.455428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0aa17363-0b47-469f-904f-6830ea02cb1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:42.456120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0aa17363-0b47-469f-904f-6830ea02cb1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:42.461851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aeea8adf-a287-4397-a3a3-1220da9cb5b4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:42.462303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aeea8adf-a287-4397-a3a3-1220da9cb5b4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:42.463065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0aa17363-0b47-469f-904f-6830ea02cb1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:42.463202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aeea8adf-a287-4397-a3a3-1220da9cb5b4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:42.463490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0aa17363-0b47-469f-904f-6830ea02cb1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:42.463670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aeea8adf-a287-4397-a3a3-1220da9cb5b4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:42.464329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0aa17363-0b47-469f-904f-6830ea02cb1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:42.464748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0aa17363-0b47-469f-904f-6830ea02cb1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:42.657645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aeea8adf-a287-4397-a3a3-1220da9cb5b4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:42.663549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0aa17363-0b47-469f-904f-6830ea02cb1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:42.667721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aeea8adf-a287-4397-a3a3-1220da9cb5b4 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1318 microversion: 2.1 time: 0.216859 Dec 15 16:35:42.668987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 624/1462] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:42 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:42.673356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0aa17363-0b47-469f-904f-6830ea02cb1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.221805 Dec 15 16:35:42.673528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6f32d261-0873-408f-a17c-0279fa45f0c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:42.673889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 839/1463] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:42 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:42.674344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6f32d261-0873-408f-a17c-0279fa45f0c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:42.682610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f32d261-0873-408f-a17c-0279fa45f0c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:42.683060 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f32d261-0873-408f-a17c-0279fa45f0c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:42.683853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f32d261-0873-408f-a17c-0279fa45f0c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:42.684289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f32d261-0873-408f-a17c-0279fa45f0c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:42.713673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6f32d261-0873-408f-a17c-0279fa45f0c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Dec 15 16:35:42.714212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 625/1464] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:43.025675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:35:43.026099 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:35:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:35:43.686090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0c7ea554-c364-40e7-a059-f29dd87ba345 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:43.686820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0c7ea554-c364-40e7-a059-f29dd87ba345 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:43.694122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ea5f2aae-da1e-47b3-bc54-f837f3c44adc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:43.694904 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ea5f2aae-da1e-47b3-bc54-f837f3c44adc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:43.696068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c7ea554-c364-40e7-a059-f29dd87ba345 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:43.696784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c7ea554-c364-40e7-a059-f29dd87ba345 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:43.697991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c7ea554-c364-40e7-a059-f29dd87ba345 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:43.698716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0c7ea554-c364-40e7-a059-f29dd87ba345 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:43.705733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea5f2aae-da1e-47b3-bc54-f837f3c44adc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:43.706311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea5f2aae-da1e-47b3-bc54-f837f3c44adc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:43.707462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea5f2aae-da1e-47b3-bc54-f837f3c44adc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:43.708092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea5f2aae-da1e-47b3-bc54-f837f3c44adc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:43.894614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0c7ea554-c364-40e7-a059-f29dd87ba345 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:43.898309 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ea5f2aae-da1e-47b3-bc54-f837f3c44adc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:43.902833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0c7ea554-c364-40e7-a059-f29dd87ba345 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1507 microversion: 2.1 time: 0.221070 Dec 15 16:35:43.903381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 840/1465] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:43 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:43.906552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ea5f2aae-da1e-47b3-bc54-f837f3c44adc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.217805 Dec 15 16:35:43.907285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 626/1466] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:43 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:43.907782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1b1fb20a-5110-4eaa-a648-60b1b75fb2d4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:43.908709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1b1fb20a-5110-4eaa-a648-60b1b75fb2d4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:43.914790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b1fb20a-5110-4eaa-a648-60b1b75fb2d4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:43.915186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b1fb20a-5110-4eaa-a648-60b1b75fb2d4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:43.915978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b1fb20a-5110-4eaa-a648-60b1b75fb2d4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:43.916571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b1fb20a-5110-4eaa-a648-60b1b75fb2d4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:43.946980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1b1fb20a-5110-4eaa-a648-60b1b75fb2d4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042426 Dec 15 16:35:43.947449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 841/1467] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:44.923606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4cfeab5c-936e-40ee-be93-84acd0b2a778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:44.924205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4cfeab5c-936e-40ee-be93-84acd0b2a778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:44.930990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cfeab5c-936e-40ee-be93-84acd0b2a778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:44.931442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cfeab5c-936e-40ee-be93-84acd0b2a778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:44.932238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cfeab5c-936e-40ee-be93-84acd0b2a778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:44.932702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cfeab5c-936e-40ee-be93-84acd0b2a778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:44.966034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e78b4e3e-cb7e-4199-9759-44a2a7f31b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:44.966965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e78b4e3e-cb7e-4199-9759-44a2a7f31b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:44.974146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e78b4e3e-cb7e-4199-9759-44a2a7f31b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:44.974590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e78b4e3e-cb7e-4199-9759-44a2a7f31b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:44.975381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e78b4e3e-cb7e-4199-9759-44a2a7f31b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:44.975813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e78b4e3e-cb7e-4199-9759-44a2a7f31b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:45.006269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e78b4e3e-cb7e-4199-9759-44a2a7f31b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Dec 15 16:35:45.009915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 842/1468] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:45.086172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4cfeab5c-936e-40ee-be93-84acd0b2a778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:45.094296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4cfeab5c-936e-40ee-be93-84acd0b2a778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.174068 Dec 15 16:35:45.094840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 627/1469] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:46.018823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f0d33339-a7ee-4670-8295-d1ec22c4cbc3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:46.019739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f0d33339-a7ee-4670-8295-d1ec22c4cbc3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:46.026505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f0d33339-a7ee-4670-8295-d1ec22c4cbc3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:46.026952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f0d33339-a7ee-4670-8295-d1ec22c4cbc3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:46.027840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f0d33339-a7ee-4670-8295-d1ec22c4cbc3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:46.028297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f0d33339-a7ee-4670-8295-d1ec22c4cbc3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:46.058066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f0d33339-a7ee-4670-8295-d1ec22c4cbc3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Dec 15 16:35:46.058735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 843/1470] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:46.114510 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8e81f968-206e-4ecc-88c1-709c59e4db03 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:46.115105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8e81f968-206e-4ecc-88c1-709c59e4db03 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:46.122352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e81f968-206e-4ecc-88c1-709c59e4db03 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:46.123021 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e81f968-206e-4ecc-88c1-709c59e4db03 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:46.123605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e81f968-206e-4ecc-88c1-709c59e4db03 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:46.124032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e81f968-206e-4ecc-88c1-709c59e4db03 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:46.267601 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8e81f968-206e-4ecc-88c1-709c59e4db03 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:46.275816 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8e81f968-206e-4ecc-88c1-709c59e4db03 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.167411 Dec 15 16:35:46.276385 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 628/1471] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:46 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:47.070356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ba927a9b-6bd7-4a63-a0ae-1b44cbb58350 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:47.071288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ba927a9b-6bd7-4a63-a0ae-1b44cbb58350 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:47.077771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba927a9b-6bd7-4a63-a0ae-1b44cbb58350 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:47.078221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba927a9b-6bd7-4a63-a0ae-1b44cbb58350 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:47.078998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba927a9b-6bd7-4a63-a0ae-1b44cbb58350 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:47.079425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba927a9b-6bd7-4a63-a0ae-1b44cbb58350 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:47.110527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ba927a9b-6bd7-4a63-a0ae-1b44cbb58350 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043913 Dec 15 16:35:47.111120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 844/1472] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:47 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:47.294781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c8e296c1-7397-42f6-a6bb-6210debfe139 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:47.295425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c8e296c1-7397-42f6-a6bb-6210debfe139 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:47.302413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8e296c1-7397-42f6-a6bb-6210debfe139 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:47.302858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8e296c1-7397-42f6-a6bb-6210debfe139 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:47.303648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8e296c1-7397-42f6-a6bb-6210debfe139 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:47.304077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8e296c1-7397-42f6-a6bb-6210debfe139 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:47.640954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c8e296c1-7397-42f6-a6bb-6210debfe139 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:47.649159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c8e296c1-7397-42f6-a6bb-6210debfe139 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.358522 Dec 15 16:35:47.649733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 629/1473] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:48.125541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6c4c792b-1980-4b1f-8d07-fbe00963800d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:48.126459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6c4c792b-1980-4b1f-8d07-fbe00963800d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:48.135850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c4c792b-1980-4b1f-8d07-fbe00963800d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:48.136646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c4c792b-1980-4b1f-8d07-fbe00963800d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:48.137479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c4c792b-1980-4b1f-8d07-fbe00963800d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:48.137960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c4c792b-1980-4b1f-8d07-fbe00963800d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:48.170198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6c4c792b-1980-4b1f-8d07-fbe00963800d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050608 Dec 15 16:35:48.170774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 845/1474] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:48.667038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fdc1702b-346e-44ff-99fc-ee66357b4edf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:48.667623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fdc1702b-346e-44ff-99fc-ee66357b4edf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:48.674754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdc1702b-346e-44ff-99fc-ee66357b4edf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:48.675201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdc1702b-346e-44ff-99fc-ee66357b4edf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:48.675988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdc1702b-346e-44ff-99fc-ee66357b4edf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:48.676421 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fdc1702b-346e-44ff-99fc-ee66357b4edf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:48.820749 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fdc1702b-346e-44ff-99fc-ee66357b4edf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:48.833870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fdc1702b-346e-44ff-99fc-ee66357b4edf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.170285 Dec 15 16:35:48.834693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 630/1475] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:49.183031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fe6d5989-f3d9-4a43-864b-8dc081b8ce3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:49.184002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fe6d5989-f3d9-4a43-864b-8dc081b8ce3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:49.191455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe6d5989-f3d9-4a43-864b-8dc081b8ce3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:49.191904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe6d5989-f3d9-4a43-864b-8dc081b8ce3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:49.192728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe6d5989-f3d9-4a43-864b-8dc081b8ce3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:49.193161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fe6d5989-f3d9-4a43-864b-8dc081b8ce3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:49.223693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fe6d5989-f3d9-4a43-864b-8dc081b8ce3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Dec 15 16:35:49.224264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 846/1476] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:49.858474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-39e359c8-3b62-4914-9ac3-81fde0541144 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:49.859053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-39e359c8-3b62-4914-9ac3-81fde0541144 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:49.865893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39e359c8-3b62-4914-9ac3-81fde0541144 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:49.866327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39e359c8-3b62-4914-9ac3-81fde0541144 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:49.867118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39e359c8-3b62-4914-9ac3-81fde0541144 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:49.867553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39e359c8-3b62-4914-9ac3-81fde0541144 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:50.031489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-39e359c8-3b62-4914-9ac3-81fde0541144 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:50.039155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-39e359c8-3b62-4914-9ac3-81fde0541144 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.184740 Dec 15 16:35:50.039717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 631/1477] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:49 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:50.237337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-40ac0b8c-6359-4180-9896-53b1656a65b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:50.238610 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-40ac0b8c-6359-4180-9896-53b1656a65b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:50.257740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40ac0b8c-6359-4180-9896-53b1656a65b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:50.258459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40ac0b8c-6359-4180-9896-53b1656a65b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:50.259698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40ac0b8c-6359-4180-9896-53b1656a65b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:50.260400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40ac0b8c-6359-4180-9896-53b1656a65b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:50.302934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-40ac0b8c-6359-4180-9896-53b1656a65b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071002 Dec 15 16:35:50.303508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 847/1478] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:51.057228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-031675f7-1792-4270-b2af-24d1655a3030 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:51.057780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-031675f7-1792-4270-b2af-24d1655a3030 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:51.064882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-031675f7-1792-4270-b2af-24d1655a3030 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:51.065331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-031675f7-1792-4270-b2af-24d1655a3030 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:51.066121 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-031675f7-1792-4270-b2af-24d1655a3030 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:51.066557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-031675f7-1792-4270-b2af-24d1655a3030 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:51.207254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-031675f7-1792-4270-b2af-24d1655a3030 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:51.218469 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-031675f7-1792-4270-b2af-24d1655a3030 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.165227 Dec 15 16:35:51.219414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 632/1479] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:51.315289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-032d34d0-d0c5-4cb8-859b-70bd05c8ee8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:51.316231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-032d34d0-d0c5-4cb8-859b-70bd05c8ee8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:51.323062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-032d34d0-d0c5-4cb8-859b-70bd05c8ee8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:51.323513 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-032d34d0-d0c5-4cb8-859b-70bd05c8ee8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:51.324308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-032d34d0-d0c5-4cb8-859b-70bd05c8ee8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:51.324775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-032d34d0-d0c5-4cb8-859b-70bd05c8ee8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:51.355866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-032d34d0-d0c5-4cb8-859b-70bd05c8ee8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Dec 15 16:35:51.356702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 848/1480] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:52.237190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-67145047-b42e-45f8-b559-e044b362f391 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:52.238058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-67145047-b42e-45f8-b559-e044b362f391 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:52.247550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67145047-b42e-45f8-b559-e044b362f391 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:52.247994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67145047-b42e-45f8-b559-e044b362f391 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:52.248835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67145047-b42e-45f8-b559-e044b362f391 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:52.249268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67145047-b42e-45f8-b559-e044b362f391 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:52.371699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6db455ac-6e1e-4d7f-a40a-b62c7c7793e7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:52.374910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6db455ac-6e1e-4d7f-a40a-b62c7c7793e7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:52.381408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6db455ac-6e1e-4d7f-a40a-b62c7c7793e7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:52.381856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6db455ac-6e1e-4d7f-a40a-b62c7c7793e7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:52.382802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6db455ac-6e1e-4d7f-a40a-b62c7c7793e7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:52.383065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6db455ac-6e1e-4d7f-a40a-b62c7c7793e7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:52.402308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-67145047-b42e-45f8-b559-e044b362f391 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:52.410106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-67145047-b42e-45f8-b559-e044b362f391 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.177835 Dec 15 16:35:52.410815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 633/1481] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:52.414178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6db455ac-6e1e-4d7f-a40a-b62c7c7793e7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048767 Dec 15 16:35:52.415053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 849/1482] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:35:53.425939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d72c66d2-8b86-452e-aa93-6dee4dd94d06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:53.426767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d72c66d2-8b86-452e-aa93-6dee4dd94d06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:53.427133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e7c16b76-26cf-482e-b89b-1faaa5c302c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:53.427745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e7c16b76-26cf-482e-b89b-1faaa5c302c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:53.433577 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d72c66d2-8b86-452e-aa93-6dee4dd94d06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:53.434028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d72c66d2-8b86-452e-aa93-6dee4dd94d06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:53.434571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7c16b76-26cf-482e-b89b-1faaa5c302c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:53.435469 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d72c66d2-8b86-452e-aa93-6dee4dd94d06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:53.435614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7c16b76-26cf-482e-b89b-1faaa5c302c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:53.435909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d72c66d2-8b86-452e-aa93-6dee4dd94d06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:53.436460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7c16b76-26cf-482e-b89b-1faaa5c302c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:53.436913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7c16b76-26cf-482e-b89b-1faaa5c302c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:53.466937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d72c66d2-8b86-452e-aa93-6dee4dd94d06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Dec 15 16:35:53.467477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 634/1483] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:53 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:53.587316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e7c16b76-26cf-482e-b89b-1faaa5c302c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:53.596791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e7c16b76-26cf-482e-b89b-1faaa5c302c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.173241 Dec 15 16:35:53.597366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 850/1484] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:53 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:54.478505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-950444e2-1710-4d9e-a8ec-4d8bc6bdfebb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:54.479417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-950444e2-1710-4d9e-a8ec-4d8bc6bdfebb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:54.486419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-950444e2-1710-4d9e-a8ec-4d8bc6bdfebb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:54.486869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-950444e2-1710-4d9e-a8ec-4d8bc6bdfebb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:54.487649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-950444e2-1710-4d9e-a8ec-4d8bc6bdfebb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:54.488079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-950444e2-1710-4d9e-a8ec-4d8bc6bdfebb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:54.518598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-950444e2-1710-4d9e-a8ec-4d8bc6bdfebb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Dec 15 16:35:54.519186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 635/1485] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:54 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:54.614394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b6092d9a-8754-49ab-8285-3a085a54bee3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:54.615155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b6092d9a-8754-49ab-8285-3a085a54bee3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:54.623737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6092d9a-8754-49ab-8285-3a085a54bee3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:54.624182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6092d9a-8754-49ab-8285-3a085a54bee3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:54.625000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6092d9a-8754-49ab-8285-3a085a54bee3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:54.625432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6092d9a-8754-49ab-8285-3a085a54bee3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:54.779833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b6092d9a-8754-49ab-8285-3a085a54bee3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:54.791586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b6092d9a-8754-49ab-8285-3a085a54bee3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.181018 Dec 15 16:35:54.792477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 851/1486] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:54 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:55.530843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ed5b716d-941e-4476-9ca8-59b609d109ec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:55.531659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ed5b716d-941e-4476-9ca8-59b609d109ec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:55.538519 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed5b716d-941e-4476-9ca8-59b609d109ec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:55.538968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed5b716d-941e-4476-9ca8-59b609d109ec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:55.539757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed5b716d-941e-4476-9ca8-59b609d109ec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:55.540192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed5b716d-941e-4476-9ca8-59b609d109ec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:55.572234 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ed5b716d-941e-4476-9ca8-59b609d109ec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Dec 15 16:35:55.572868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 636/1487] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:55.810118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7addc157-0d65-4cc7-b1c3-5586cf4ad393 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:55.810739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7addc157-0d65-4cc7-b1c3-5586cf4ad393 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:55.817668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7addc157-0d65-4cc7-b1c3-5586cf4ad393 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:55.818116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7addc157-0d65-4cc7-b1c3-5586cf4ad393 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:55.818899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7addc157-0d65-4cc7-b1c3-5586cf4ad393 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:55.819424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7addc157-0d65-4cc7-b1c3-5586cf4ad393 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:55.962220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7addc157-0d65-4cc7-b1c3-5586cf4ad393 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:55.970714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7addc157-0d65-4cc7-b1c3-5586cf4ad393 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.164991 Dec 15 16:35:55.971307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 852/1488] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:56.584247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-519dcf9c-be95-40f3-903d-468beb70871c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:56.585178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-519dcf9c-be95-40f3-903d-468beb70871c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:56.591979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-519dcf9c-be95-40f3-903d-468beb70871c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:56.592419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-519dcf9c-be95-40f3-903d-468beb70871c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:56.593259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-519dcf9c-be95-40f3-903d-468beb70871c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:56.594049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-519dcf9c-be95-40f3-903d-468beb70871c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:56.628543 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-519dcf9c-be95-40f3-903d-468beb70871c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047988 Dec 15 16:35:56.629114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 637/1489] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:56.990390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-215593ff-8ca4-47d1-b7b6-484f518c04cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:56.990974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-215593ff-8ca4-47d1-b7b6-484f518c04cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:56.999534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-215593ff-8ca4-47d1-b7b6-484f518c04cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:56.999984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-215593ff-8ca4-47d1-b7b6-484f518c04cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:57.000824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-215593ff-8ca4-47d1-b7b6-484f518c04cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:57.001267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-215593ff-8ca4-47d1-b7b6-484f518c04cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:57.145152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-215593ff-8ca4-47d1-b7b6-484f518c04cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:57.152659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-215593ff-8ca4-47d1-b7b6-484f518c04cd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.168621 Dec 15 16:35:57.153320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 853/1490] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:57.640826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-672dddcf-5736-4df0-889f-2b1da50cc962 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:57.641743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-672dddcf-5736-4df0-889f-2b1da50cc962 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:57.648455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-672dddcf-5736-4df0-889f-2b1da50cc962 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:57.648893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-672dddcf-5736-4df0-889f-2b1da50cc962 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:57.649706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-672dddcf-5736-4df0-889f-2b1da50cc962 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:57.650136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-672dddcf-5736-4df0-889f-2b1da50cc962 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:57.680460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-672dddcf-5736-4df0-889f-2b1da50cc962 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Dec 15 16:35:57.681032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 638/1491] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:58.170285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-18587b99-c3d5-4949-97e4-0008d15c6b91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:58.170896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-18587b99-c3d5-4949-97e4-0008d15c6b91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:58.178383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18587b99-c3d5-4949-97e4-0008d15c6b91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:58.178822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18587b99-c3d5-4949-97e4-0008d15c6b91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:58.179606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18587b99-c3d5-4949-97e4-0008d15c6b91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:58.180036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18587b99-c3d5-4949-97e4-0008d15c6b91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:58.368472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-18587b99-c3d5-4949-97e4-0008d15c6b91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:58.376807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-18587b99-c3d5-4949-97e4-0008d15c6b91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.210416 Dec 15 16:35:58.377365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 854/1492] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:58.692866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f03f099e-fdae-45fd-a214-77372e20eafa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:58.693688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f03f099e-fdae-45fd-a214-77372e20eafa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:58.702129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f03f099e-fdae-45fd-a214-77372e20eafa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:58.703032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f03f099e-fdae-45fd-a214-77372e20eafa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:58.704687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f03f099e-fdae-45fd-a214-77372e20eafa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:58.705288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f03f099e-fdae-45fd-a214-77372e20eafa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:58.743412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f03f099e-fdae-45fd-a214-77372e20eafa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054456 Dec 15 16:35:58.743966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 639/1493] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:35:59.394483 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-177dee25-0807-4d18-9fc7-5eff84aadb62 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:59.395078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-177dee25-0807-4d18-9fc7-5eff84aadb62 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:59.401642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-177dee25-0807-4d18-9fc7-5eff84aadb62 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:59.402087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-177dee25-0807-4d18-9fc7-5eff84aadb62 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:59.402952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-177dee25-0807-4d18-9fc7-5eff84aadb62 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:59.403353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-177dee25-0807-4d18-9fc7-5eff84aadb62 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:59.556465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-177dee25-0807-4d18-9fc7-5eff84aadb62 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:35:59.564711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-177dee25-0807-4d18-9fc7-5eff84aadb62 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.174121 Dec 15 16:35:59.565289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 855/1494] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:35:59 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:35:59.756801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f4cda168-7709-4a94-a3d3-164f1227f4ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:35:59.757607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f4cda168-7709-4a94-a3d3-164f1227f4ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:35:59.764746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f4cda168-7709-4a94-a3d3-164f1227f4ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:59.765198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f4cda168-7709-4a94-a3d3-164f1227f4ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:59.766024 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f4cda168-7709-4a94-a3d3-164f1227f4ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:35:59.766461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f4cda168-7709-4a94-a3d3-164f1227f4ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:35:59.796815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f4cda168-7709-4a94-a3d3-164f1227f4ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Dec 15 16:35:59.797387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 640/1495] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:35:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:00.582155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3bf2157f-9643-4c7b-a6e3-5918df27cd72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:00.583093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3bf2157f-9643-4c7b-a6e3-5918df27cd72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:00.591080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3bf2157f-9643-4c7b-a6e3-5918df27cd72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:00.591806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3bf2157f-9643-4c7b-a6e3-5918df27cd72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:00.593035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3bf2157f-9643-4c7b-a6e3-5918df27cd72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:00.593989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3bf2157f-9643-4c7b-a6e3-5918df27cd72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:00.741998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3bf2157f-9643-4c7b-a6e3-5918df27cd72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:00.750898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3bf2157f-9643-4c7b-a6e3-5918df27cd72 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.172755 Dec 15 16:36:00.751498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 856/1496] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:00.810674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6e7c47e3-0aa8-40f5-b6e7-e1e013e5d72e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:00.811808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6e7c47e3-0aa8-40f5-b6e7-e1e013e5d72e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:00.819579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e7c47e3-0aa8-40f5-b6e7-e1e013e5d72e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:00.820313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e7c47e3-0aa8-40f5-b6e7-e1e013e5d72e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:00.822421 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e7c47e3-0aa8-40f5-b6e7-e1e013e5d72e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:00.823262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e7c47e3-0aa8-40f5-b6e7-e1e013e5d72e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:00.855601 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6e7c47e3-0aa8-40f5-b6e7-e1e013e5d72e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050107 Dec 15 16:36:00.856145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 641/1497] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:01.767930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4c0dc849-c390-4297-a256-536034983b34 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:01.768586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4c0dc849-c390-4297-a256-536034983b34 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:01.775592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c0dc849-c390-4297-a256-536034983b34 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:01.776049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c0dc849-c390-4297-a256-536034983b34 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:01.776886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c0dc849-c390-4297-a256-536034983b34 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:01.777320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c0dc849-c390-4297-a256-536034983b34 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:01.868373 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4d4f543a-1fe5-446c-ab92-be49d1c31e0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:01.869322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4d4f543a-1fe5-446c-ab92-be49d1c31e0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:01.876680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d4f543a-1fe5-446c-ab92-be49d1c31e0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:01.877129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d4f543a-1fe5-446c-ab92-be49d1c31e0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:01.877909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d4f543a-1fe5-446c-ab92-be49d1c31e0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:01.878372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d4f543a-1fe5-446c-ab92-be49d1c31e0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:01.909731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4d4f543a-1fe5-446c-ab92-be49d1c31e0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Dec 15 16:36:01.910517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 642/1498] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:01.919038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4c0dc849-c390-4297-a256-536034983b34 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:01.926695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4c0dc849-c390-4297-a256-536034983b34 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.162567 Dec 15 16:36:01.927270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 857/1499] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:02.924842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7c73bd89-2148-460a-b48f-736bd161dc01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:02.925892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7c73bd89-2148-460a-b48f-736bd161dc01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:02.935669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c73bd89-2148-460a-b48f-736bd161dc01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:02.936227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c73bd89-2148-460a-b48f-736bd161dc01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:02.937476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c73bd89-2148-460a-b48f-736bd161dc01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:02.938106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c73bd89-2148-460a-b48f-736bd161dc01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:02.946214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-427f3652-2c4e-47b9-9d0e-8e88f04d47dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:02.946834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-427f3652-2c4e-47b9-9d0e-8e88f04d47dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:02.954086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-427f3652-2c4e-47b9-9d0e-8e88f04d47dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:02.954537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-427f3652-2c4e-47b9-9d0e-8e88f04d47dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:02.955321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-427f3652-2c4e-47b9-9d0e-8e88f04d47dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:02.955749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-427f3652-2c4e-47b9-9d0e-8e88f04d47dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:02.972283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7c73bd89-2148-460a-b48f-736bd161dc01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053253 Dec 15 16:36:02.973227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 643/1500] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:03.098895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-427f3652-2c4e-47b9-9d0e-8e88f04d47dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:03.107281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-427f3652-2c4e-47b9-9d0e-8e88f04d47dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.166140 Dec 15 16:36:03.107841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 858/1501] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:03.985354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bbcdc65e-10c3-44b6-9609-32da10a5b182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:03.986290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bbcdc65e-10c3-44b6-9609-32da10a5b182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:03.994603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bbcdc65e-10c3-44b6-9609-32da10a5b182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:03.995195 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bbcdc65e-10c3-44b6-9609-32da10a5b182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:03.996338 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bbcdc65e-10c3-44b6-9609-32da10a5b182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:03.997144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bbcdc65e-10c3-44b6-9609-32da10a5b182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:04.029975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bbcdc65e-10c3-44b6-9609-32da10a5b182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049150 Dec 15 16:36:04.030554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 644/1502] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:04.125464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c7f01b26-64f3-4c94-9d6f-2c32b7dc745d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:04.126090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c7f01b26-64f3-4c94-9d6f-2c32b7dc745d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:04.132872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7f01b26-64f3-4c94-9d6f-2c32b7dc745d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:04.133328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7f01b26-64f3-4c94-9d6f-2c32b7dc745d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:04.134140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7f01b26-64f3-4c94-9d6f-2c32b7dc745d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:04.134579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c7f01b26-64f3-4c94-9d6f-2c32b7dc745d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:04.284660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c7f01b26-64f3-4c94-9d6f-2c32b7dc745d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:04.294347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c7f01b26-64f3-4c94-9d6f-2c32b7dc745d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.173400 Dec 15 16:36:04.294929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 859/1503] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:05.044264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4179869d-aa82-439a-9ba4-478d14a78da2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:05.045217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4179869d-aa82-439a-9ba4-478d14a78da2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:05.051978 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4179869d-aa82-439a-9ba4-478d14a78da2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:05.052451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4179869d-aa82-439a-9ba4-478d14a78da2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:05.053242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4179869d-aa82-439a-9ba4-478d14a78da2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:05.053675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4179869d-aa82-439a-9ba4-478d14a78da2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:05.085202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4179869d-aa82-439a-9ba4-478d14a78da2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046721 Dec 15 16:36:05.085763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 645/1504] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:05.316175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-730c13ae-ec10-4c28-96e5-c544bbbc1d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:05.316815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-730c13ae-ec10-4c28-96e5-c544bbbc1d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:05.325807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-730c13ae-ec10-4c28-96e5-c544bbbc1d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:05.326373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-730c13ae-ec10-4c28-96e5-c544bbbc1d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:05.327583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-730c13ae-ec10-4c28-96e5-c544bbbc1d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:05.328220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-730c13ae-ec10-4c28-96e5-c544bbbc1d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:05.479300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-730c13ae-ec10-4c28-96e5-c544bbbc1d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:05.488253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-730c13ae-ec10-4c28-96e5-c544bbbc1d0d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.175825 Dec 15 16:36:05.488915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 860/1505] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:06.097499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-42e26b9d-0ed3-405d-aa8f-295aed90e4fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:06.098383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-42e26b9d-0ed3-405d-aa8f-295aed90e4fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:06.104929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e26b9d-0ed3-405d-aa8f-295aed90e4fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:06.105377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e26b9d-0ed3-405d-aa8f-295aed90e4fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:06.106717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e26b9d-0ed3-405d-aa8f-295aed90e4fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:06.106896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42e26b9d-0ed3-405d-aa8f-295aed90e4fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:06.136644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-42e26b9d-0ed3-405d-aa8f-295aed90e4fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Dec 15 16:36:06.137261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 646/1506] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:06.507499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3395066e-c2d9-4011-b197-cb1621960e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:06.508242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3395066e-c2d9-4011-b197-cb1621960e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:06.516650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3395066e-c2d9-4011-b197-cb1621960e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:06.517543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3395066e-c2d9-4011-b197-cb1621960e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:06.518536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3395066e-c2d9-4011-b197-cb1621960e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:06.520050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3395066e-c2d9-4011-b197-cb1621960e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:06.664829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3395066e-c2d9-4011-b197-cb1621960e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:06.672905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3395066e-c2d9-4011-b197-cb1621960e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.169952 Dec 15 16:36:06.673475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 861/1507] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:07.148933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8dd3f999-45d9-4f68-afef-03d03df6259e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:07.149842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8dd3f999-45d9-4f68-afef-03d03df6259e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:07.156566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8dd3f999-45d9-4f68-afef-03d03df6259e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:07.156988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8dd3f999-45d9-4f68-afef-03d03df6259e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:07.157922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8dd3f999-45d9-4f68-afef-03d03df6259e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:07.158353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8dd3f999-45d9-4f68-afef-03d03df6259e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:07.189412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8dd3f999-45d9-4f68-afef-03d03df6259e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Dec 15 16:36:07.189975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 647/1508] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:07.691198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-262ae40a-cc0c-400e-96b5-bb406c02ad2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:07.692121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-262ae40a-cc0c-400e-96b5-bb406c02ad2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:07.701850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-262ae40a-cc0c-400e-96b5-bb406c02ad2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:07.702296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-262ae40a-cc0c-400e-96b5-bb406c02ad2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:07.703085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-262ae40a-cc0c-400e-96b5-bb406c02ad2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:07.703514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-262ae40a-cc0c-400e-96b5-bb406c02ad2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:07.854222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-262ae40a-cc0c-400e-96b5-bb406c02ad2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:07.862831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-262ae40a-cc0c-400e-96b5-bb406c02ad2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.175525 Dec 15 16:36:07.863432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 862/1509] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:07 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:08.203775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-084ba0d8-6bc5-4c26-8214-3cf172e71479 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:08.204713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-084ba0d8-6bc5-4c26-8214-3cf172e71479 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:08.211345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-084ba0d8-6bc5-4c26-8214-3cf172e71479 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:08.211788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-084ba0d8-6bc5-4c26-8214-3cf172e71479 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:08.212623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-084ba0d8-6bc5-4c26-8214-3cf172e71479 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:08.213052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-084ba0d8-6bc5-4c26-8214-3cf172e71479 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:08.246667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-084ba0d8-6bc5-4c26-8214-3cf172e71479 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048039 Dec 15 16:36:08.247232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 648/1510] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:08.881496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-60986b50-85de-49e5-b910-5528a54b1a96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:08.882184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-60986b50-85de-49e5-b910-5528a54b1a96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:08.889455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60986b50-85de-49e5-b910-5528a54b1a96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:08.890198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60986b50-85de-49e5-b910-5528a54b1a96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:08.890998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60986b50-85de-49e5-b910-5528a54b1a96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:08.891450 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60986b50-85de-49e5-b910-5528a54b1a96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:09.041302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-60986b50-85de-49e5-b910-5528a54b1a96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:09.049057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-60986b50-85de-49e5-b910-5528a54b1a96 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.171732 Dec 15 16:36:09.049632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 863/1511] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:09.259122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-91eda826-c1c5-4515-85fa-3a9470585998 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:09.259933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-91eda826-c1c5-4515-85fa-3a9470585998 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:09.267205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91eda826-c1c5-4515-85fa-3a9470585998 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:09.267652 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91eda826-c1c5-4515-85fa-3a9470585998 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:09.268460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91eda826-c1c5-4515-85fa-3a9470585998 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:09.268894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91eda826-c1c5-4515-85fa-3a9470585998 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:09.299987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-91eda826-c1c5-4515-85fa-3a9470585998 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Dec 15 16:36:09.300576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 649/1512] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:10.071984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e836d99c-97b5-491f-9a9a-ea62ae263058 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:10.072735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e836d99c-97b5-491f-9a9a-ea62ae263058 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:10.082329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e836d99c-97b5-491f-9a9a-ea62ae263058 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:10.082916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e836d99c-97b5-491f-9a9a-ea62ae263058 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:10.084097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e836d99c-97b5-491f-9a9a-ea62ae263058 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:10.084696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e836d99c-97b5-491f-9a9a-ea62ae263058 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:10.232766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e836d99c-97b5-491f-9a9a-ea62ae263058 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:10.243663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e836d99c-97b5-491f-9a9a-ea62ae263058 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.179800 Dec 15 16:36:10.244449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 864/1513] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:10.313581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a259d67b-f11c-4671-ab06-984bf0a43192 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:10.314680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a259d67b-f11c-4671-ab06-984bf0a43192 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:10.321377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a259d67b-f11c-4671-ab06-984bf0a43192 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:10.321821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a259d67b-f11c-4671-ab06-984bf0a43192 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:10.322678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a259d67b-f11c-4671-ab06-984bf0a43192 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:10.323189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a259d67b-f11c-4671-ab06-984bf0a43192 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:10.355253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a259d67b-f11c-4671-ab06-984bf0a43192 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046847 Dec 15 16:36:10.355792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 650/1514] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:11.262531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ab348470-fa3c-408a-875f-45a93dee4a26 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:11.263374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ab348470-fa3c-408a-875f-45a93dee4a26 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:11.271173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab348470-fa3c-408a-875f-45a93dee4a26 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:11.271616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab348470-fa3c-408a-875f-45a93dee4a26 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:11.272396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab348470-fa3c-408a-875f-45a93dee4a26 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:11.272850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab348470-fa3c-408a-875f-45a93dee4a26 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:11.367528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7edb994d-2745-4aed-a3f1-9b9f739c22ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:11.368423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7edb994d-2745-4aed-a3f1-9b9f739c22ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:11.375257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7edb994d-2745-4aed-a3f1-9b9f739c22ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:11.375845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7edb994d-2745-4aed-a3f1-9b9f739c22ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:11.376671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7edb994d-2745-4aed-a3f1-9b9f739c22ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:11.377072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7edb994d-2745-4aed-a3f1-9b9f739c22ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:11.407125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7edb994d-2745-4aed-a3f1-9b9f739c22ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Dec 15 16:36:11.407722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 651/1515] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:11.418408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ab348470-fa3c-408a-875f-45a93dee4a26 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:11.425903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ab348470-fa3c-408a-875f-45a93dee4a26 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.168521 Dec 15 16:36:11.426469 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 865/1516] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:11 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:12.419266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6eb9ebea-a010-4983-b74f-d8527c266ff3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:12.420074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6eb9ebea-a010-4983-b74f-d8527c266ff3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:12.426841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6eb9ebea-a010-4983-b74f-d8527c266ff3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:12.427289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6eb9ebea-a010-4983-b74f-d8527c266ff3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:12.428071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6eb9ebea-a010-4983-b74f-d8527c266ff3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:12.428551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6eb9ebea-a010-4983-b74f-d8527c266ff3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:12.442690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d6727d54-b8a3-4671-a28d-5ee30cbbc9c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:12.443411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d6727d54-b8a3-4671-a28d-5ee30cbbc9c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:12.449850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6727d54-b8a3-4671-a28d-5ee30cbbc9c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:12.450297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6727d54-b8a3-4671-a28d-5ee30cbbc9c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:12.451081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6727d54-b8a3-4671-a28d-5ee30cbbc9c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:12.451514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6727d54-b8a3-4671-a28d-5ee30cbbc9c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:12.458882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6eb9ebea-a010-4983-b74f-d8527c266ff3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043559 Dec 15 16:36:12.459478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 652/1517] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:12.606608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d6727d54-b8a3-4671-a28d-5ee30cbbc9c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:12.614512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d6727d54-b8a3-4671-a28d-5ee30cbbc9c3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.175443 Dec 15 16:36:12.615096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 866/1518] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:12 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:13.473376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4a28f969-c251-42ec-8337-a948b4684cdc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:13.474456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4a28f969-c251-42ec-8337-a948b4684cdc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:13.483174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a28f969-c251-42ec-8337-a948b4684cdc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:13.483783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a28f969-c251-42ec-8337-a948b4684cdc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:13.484858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a28f969-c251-42ec-8337-a948b4684cdc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:13.485291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a28f969-c251-42ec-8337-a948b4684cdc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:13.514832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4a28f969-c251-42ec-8337-a948b4684cdc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047164 Dec 15 16:36:13.515457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 653/1519] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:13 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:13.632479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-de84e8f4-b5c7-4519-8564-4af052520e1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:13.633167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-de84e8f4-b5c7-4519-8564-4af052520e1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:13.641183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de84e8f4-b5c7-4519-8564-4af052520e1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:13.641790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de84e8f4-b5c7-4519-8564-4af052520e1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:13.642774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de84e8f4-b5c7-4519-8564-4af052520e1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:13.643363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de84e8f4-b5c7-4519-8564-4af052520e1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:13.789234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-de84e8f4-b5c7-4519-8564-4af052520e1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:13.796702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-de84e8f4-b5c7-4519-8564-4af052520e1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.168205 Dec 15 16:36:13.797289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 867/1520] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:14.527183 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-053cb809-c209-4071-b515-5326bd2f75f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:14.527965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-053cb809-c209-4071-b515-5326bd2f75f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:14.534986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-053cb809-c209-4071-b515-5326bd2f75f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:14.535441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-053cb809-c209-4071-b515-5326bd2f75f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:14.536257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-053cb809-c209-4071-b515-5326bd2f75f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:14.536716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-053cb809-c209-4071-b515-5326bd2f75f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:14.567251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-053cb809-c209-4071-b515-5326bd2f75f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Dec 15 16:36:14.567808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 654/1521] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:14 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:14.816951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7642d037-542d-48ea-a89e-8634f4f10590 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:14.817556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7642d037-542d-48ea-a89e-8634f4f10590 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:14.826821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7642d037-542d-48ea-a89e-8634f4f10590 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:14.827390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7642d037-542d-48ea-a89e-8634f4f10590 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:14.828561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7642d037-542d-48ea-a89e-8634f4f10590 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:14.829305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7642d037-542d-48ea-a89e-8634f4f10590 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:14.976895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7642d037-542d-48ea-a89e-8634f4f10590 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:14.987739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7642d037-542d-48ea-a89e-8634f4f10590 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.176772 Dec 15 16:36:14.988315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 868/1522] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:15.581159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-35e9eb2e-27a1-4bea-8011-db3cb50400a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:15.582067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-35e9eb2e-27a1-4bea-8011-db3cb50400a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:15.589070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-35e9eb2e-27a1-4bea-8011-db3cb50400a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:15.589526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-35e9eb2e-27a1-4bea-8011-db3cb50400a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:15.590316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-35e9eb2e-27a1-4bea-8011-db3cb50400a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:15.590752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-35e9eb2e-27a1-4bea-8011-db3cb50400a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:15.620613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-35e9eb2e-27a1-4bea-8011-db3cb50400a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Dec 15 16:36:15.621172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 655/1523] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:16.005303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1ec37bdf-0a5c-4719-8dee-670b4a5282d7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:16.005888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1ec37bdf-0a5c-4719-8dee-670b4a5282d7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:16.012815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ec37bdf-0a5c-4719-8dee-670b4a5282d7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:16.013267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ec37bdf-0a5c-4719-8dee-670b4a5282d7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:16.014064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ec37bdf-0a5c-4719-8dee-670b4a5282d7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:16.014495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ec37bdf-0a5c-4719-8dee-670b4a5282d7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:16.059583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:36:16.059983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:36:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:36:16.163761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1ec37bdf-0a5c-4719-8dee-670b4a5282d7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:16.175194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1ec37bdf-0a5c-4719-8dee-670b4a5282d7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.173460 Dec 15 16:36:16.176100 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 869/1524] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:16 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:16.636496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9f149f77-ad3f-4861-838b-4e5b4f5dc882 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:16.638001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9f149f77-ad3f-4861-838b-4e5b4f5dc882 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:16.647335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f149f77-ad3f-4861-838b-4e5b4f5dc882 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:16.647937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f149f77-ad3f-4861-838b-4e5b4f5dc882 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:16.649070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f149f77-ad3f-4861-838b-4e5b4f5dc882 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:16.649649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f149f77-ad3f-4861-838b-4e5b4f5dc882 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:16.681438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9f149f77-ad3f-4861-838b-4e5b4f5dc882 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049865 Dec 15 16:36:16.681998 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 656/1525] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:16 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:17.198208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8126ad38-7108-4f2a-8490-2d1f93996083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:17.198834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8126ad38-7108-4f2a-8490-2d1f93996083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:17.206324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8126ad38-7108-4f2a-8490-2d1f93996083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:17.206773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8126ad38-7108-4f2a-8490-2d1f93996083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:17.207586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8126ad38-7108-4f2a-8490-2d1f93996083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:17.207995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8126ad38-7108-4f2a-8490-2d1f93996083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:17.345204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8126ad38-7108-4f2a-8490-2d1f93996083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:17.353024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8126ad38-7108-4f2a-8490-2d1f93996083 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.158655 Dec 15 16:36:17.353604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 870/1526] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:17 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:17.693754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-14c96b2e-1258-416e-a407-30254461dc38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:17.694654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-14c96b2e-1258-416e-a407-30254461dc38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:17.701549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14c96b2e-1258-416e-a407-30254461dc38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:17.701992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14c96b2e-1258-416e-a407-30254461dc38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:17.702774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14c96b2e-1258-416e-a407-30254461dc38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:17.703204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14c96b2e-1258-416e-a407-30254461dc38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:17.736060 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-14c96b2e-1258-416e-a407-30254461dc38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046059 Dec 15 16:36:17.736676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 657/1527] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:18.374501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3ca06c31-6fe4-489e-81c9-87519eabd2dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:18.375095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3ca06c31-6fe4-489e-81c9-87519eabd2dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:18.381768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ca06c31-6fe4-489e-81c9-87519eabd2dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:18.382219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ca06c31-6fe4-489e-81c9-87519eabd2dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:18.382999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ca06c31-6fe4-489e-81c9-87519eabd2dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:18.383428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ca06c31-6fe4-489e-81c9-87519eabd2dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:18.518834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3ca06c31-6fe4-489e-81c9-87519eabd2dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:18.526403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3ca06c31-6fe4-489e-81c9-87519eabd2dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.155915 Dec 15 16:36:18.527056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 871/1528] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:18.747526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-da028194-ce3e-4d9c-8037-f8f49c1b33b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:18.748341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-da028194-ce3e-4d9c-8037-f8f49c1b33b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:18.755616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da028194-ce3e-4d9c-8037-f8f49c1b33b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:18.756067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da028194-ce3e-4d9c-8037-f8f49c1b33b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:18.756894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da028194-ce3e-4d9c-8037-f8f49c1b33b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:18.757325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da028194-ce3e-4d9c-8037-f8f49c1b33b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:18.798672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-da028194-ce3e-4d9c-8037-f8f49c1b33b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054990 Dec 15 16:36:18.799242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 658/1529] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:19.550588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-da05d4ed-95e2-4614-aa07-b59ccef791f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:19.551408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-da05d4ed-95e2-4614-aa07-b59ccef791f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:19.559506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-da05d4ed-95e2-4614-aa07-b59ccef791f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:19.559951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-da05d4ed-95e2-4614-aa07-b59ccef791f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:19.560797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-da05d4ed-95e2-4614-aa07-b59ccef791f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:19.561230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-da05d4ed-95e2-4614-aa07-b59ccef791f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:19.728340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-da05d4ed-95e2-4614-aa07-b59ccef791f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:19.739661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-da05d4ed-95e2-4614-aa07-b59ccef791f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.197966 Dec 15 16:36:19.740214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 872/1530] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:19.813980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-327f477e-44b5-4fb7-8a48-09c36da4e234 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:19.814914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-327f477e-44b5-4fb7-8a48-09c36da4e234 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:19.821754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-327f477e-44b5-4fb7-8a48-09c36da4e234 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:19.822206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-327f477e-44b5-4fb7-8a48-09c36da4e234 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:19.823002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-327f477e-44b5-4fb7-8a48-09c36da4e234 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:19.823439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-327f477e-44b5-4fb7-8a48-09c36da4e234 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:19.854208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-327f477e-44b5-4fb7-8a48-09c36da4e234 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046154 Dec 15 16:36:19.854769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 659/1531] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:19 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:20.760925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fd281c8f-c6ea-4632-9aa3-4817b28d111f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:20.761529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fd281c8f-c6ea-4632-9aa3-4817b28d111f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:20.768386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd281c8f-c6ea-4632-9aa3-4817b28d111f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:20.768837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd281c8f-c6ea-4632-9aa3-4817b28d111f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:20.769648 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd281c8f-c6ea-4632-9aa3-4817b28d111f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:20.770075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd281c8f-c6ea-4632-9aa3-4817b28d111f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:20.866595 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3eeb935f-c003-45a2-bc4c-ebebfeefecb5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:20.867535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3eeb935f-c003-45a2-bc4c-ebebfeefecb5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:20.874470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3eeb935f-c003-45a2-bc4c-ebebfeefecb5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:20.874915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3eeb935f-c003-45a2-bc4c-ebebfeefecb5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:20.875704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3eeb935f-c003-45a2-bc4c-ebebfeefecb5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:20.876131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3eeb935f-c003-45a2-bc4c-ebebfeefecb5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:20.906012 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3eeb935f-c003-45a2-bc4c-ebebfeefecb5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 Dec 15 16:36:20.906605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 660/1532] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:20 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:20.917127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fd281c8f-c6ea-4632-9aa3-4817b28d111f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:20.924785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fd281c8f-c6ea-4632-9aa3-4817b28d111f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.167575 Dec 15 16:36:20.925457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 873/1533] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:20 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:21.919318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cc997707-eb07-4d71-a75a-fe69ee08b2bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:21.920222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cc997707-eb07-4d71-a75a-fe69ee08b2bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:21.927156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc997707-eb07-4d71-a75a-fe69ee08b2bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:21.927598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc997707-eb07-4d71-a75a-fe69ee08b2bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:21.928379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc997707-eb07-4d71-a75a-fe69ee08b2bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:21.928839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc997707-eb07-4d71-a75a-fe69ee08b2bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:21.942111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f8c2a62c-ab47-428f-adf8-3c7c89581781 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:21.942712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f8c2a62c-ab47-428f-adf8-3c7c89581781 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:21.949395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8c2a62c-ab47-428f-adf8-3c7c89581781 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:21.949850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8c2a62c-ab47-428f-adf8-3c7c89581781 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:21.950641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8c2a62c-ab47-428f-adf8-3c7c89581781 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:21.951072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8c2a62c-ab47-428f-adf8-3c7c89581781 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:21.959617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cc997707-eb07-4d71-a75a-fe69ee08b2bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Dec 15 16:36:21.960172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 661/1534] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:22.094861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f8c2a62c-ab47-428f-adf8-3c7c89581781 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:22.102769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f8c2a62c-ab47-428f-adf8-3c7c89581781 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.164476 Dec 15 16:36:22.103343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 874/1535] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:22.972458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ede8eb2c-ef07-47e5-9e9f-5559f179d722 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:22.973494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ede8eb2c-ef07-47e5-9e9f-5559f179d722 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:22.980812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ede8eb2c-ef07-47e5-9e9f-5559f179d722 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:22.981312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ede8eb2c-ef07-47e5-9e9f-5559f179d722 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:22.982163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ede8eb2c-ef07-47e5-9e9f-5559f179d722 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:22.982654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ede8eb2c-ef07-47e5-9e9f-5559f179d722 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:23.020883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ede8eb2c-ef07-47e5-9e9f-5559f179d722 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053368 Dec 15 16:36:23.021458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 662/1536] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:23.119608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e109d0c5-47ee-450e-846e-d01cc0d83fe1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:23.120242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e109d0c5-47ee-450e-846e-d01cc0d83fe1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:23.127482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e109d0c5-47ee-450e-846e-d01cc0d83fe1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:23.127963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e109d0c5-47ee-450e-846e-d01cc0d83fe1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:23.128840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e109d0c5-47ee-450e-846e-d01cc0d83fe1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:23.129292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e109d0c5-47ee-450e-846e-d01cc0d83fe1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:23.275216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e109d0c5-47ee-450e-846e-d01cc0d83fe1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:23.283039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e109d0c5-47ee-450e-846e-d01cc0d83fe1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.167282 Dec 15 16:36:23.283616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 875/1537] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:23 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:24.032869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f09b57c2-7601-4da6-b17f-1ed2ab95543f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:24.033796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f09b57c2-7601-4da6-b17f-1ed2ab95543f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:24.041267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f09b57c2-7601-4da6-b17f-1ed2ab95543f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:24.041715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f09b57c2-7601-4da6-b17f-1ed2ab95543f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:24.042518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f09b57c2-7601-4da6-b17f-1ed2ab95543f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:24.042949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f09b57c2-7601-4da6-b17f-1ed2ab95543f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:24.075465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f09b57c2-7601-4da6-b17f-1ed2ab95543f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Dec 15 16:36:24.075954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 663/1538] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:24 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:24.302117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1163d5ed-277d-4c86-8653-1db2d2d7fd4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:24.302751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1163d5ed-277d-4c86-8653-1db2d2d7fd4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:24.312646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1163d5ed-277d-4c86-8653-1db2d2d7fd4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:24.313281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1163d5ed-277d-4c86-8653-1db2d2d7fd4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:24.314408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1163d5ed-277d-4c86-8653-1db2d2d7fd4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:24.314911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1163d5ed-277d-4c86-8653-1db2d2d7fd4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:24.468732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1163d5ed-277d-4c86-8653-1db2d2d7fd4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:24.477160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1163d5ed-277d-4c86-8653-1db2d2d7fd4f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.179550 Dec 15 16:36:24.477733 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 876/1539] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:25.088829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1eb0cfaa-1896-4909-b0fb-ebe4415905ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:25.089753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1eb0cfaa-1896-4909-b0fb-ebe4415905ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:25.097052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1eb0cfaa-1896-4909-b0fb-ebe4415905ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:25.097495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1eb0cfaa-1896-4909-b0fb-ebe4415905ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:25.098280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1eb0cfaa-1896-4909-b0fb-ebe4415905ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:25.098704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1eb0cfaa-1896-4909-b0fb-ebe4415905ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:25.135024 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1eb0cfaa-1896-4909-b0fb-ebe4415905ef tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049935 Dec 15 16:36:25.135748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 664/1540] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:25 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:25.495172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4046ff7d-50e8-415f-a685-95f8dd267224 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:25.495761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4046ff7d-50e8-415f-a685-95f8dd267224 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:25.502709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4046ff7d-50e8-415f-a685-95f8dd267224 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:25.503184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4046ff7d-50e8-415f-a685-95f8dd267224 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:25.503964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4046ff7d-50e8-415f-a685-95f8dd267224 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:25.504398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4046ff7d-50e8-415f-a685-95f8dd267224 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:25.647992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4046ff7d-50e8-415f-a685-95f8dd267224 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:25.660037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4046ff7d-50e8-415f-a685-95f8dd267224 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.168438 Dec 15 16:36:25.660924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 877/1541] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:26.150449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b4a70627-e72c-4f2b-a4a1-98de3ffa676b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:26.151370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b4a70627-e72c-4f2b-a4a1-98de3ffa676b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:26.158251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b4a70627-e72c-4f2b-a4a1-98de3ffa676b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:26.158713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b4a70627-e72c-4f2b-a4a1-98de3ffa676b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:26.159505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b4a70627-e72c-4f2b-a4a1-98de3ffa676b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:26.159949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b4a70627-e72c-4f2b-a4a1-98de3ffa676b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:26.191285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b4a70627-e72c-4f2b-a4a1-98de3ffa676b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Dec 15 16:36:26.192073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 665/1542] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:26.678342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-27f2bcc0-e246-45a2-ab0b-61b421ec5c36 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:26.678984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-27f2bcc0-e246-45a2-ab0b-61b421ec5c36 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:26.685624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27f2bcc0-e246-45a2-ab0b-61b421ec5c36 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:26.686079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27f2bcc0-e246-45a2-ab0b-61b421ec5c36 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:26.686872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27f2bcc0-e246-45a2-ab0b-61b421ec5c36 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:26.687315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27f2bcc0-e246-45a2-ab0b-61b421ec5c36 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:26.840480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-27f2bcc0-e246-45a2-ab0b-61b421ec5c36 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:26.848868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-27f2bcc0-e246-45a2-ab0b-61b421ec5c36 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.174452 Dec 15 16:36:26.849450 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 878/1543] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:26 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:27.205009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-25b520e2-8963-42a5-ab2f-ccfe81f8ab02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:27.205917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-25b520e2-8963-42a5-ab2f-ccfe81f8ab02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:27.212645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25b520e2-8963-42a5-ab2f-ccfe81f8ab02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:27.213097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25b520e2-8963-42a5-ab2f-ccfe81f8ab02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:27.213876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25b520e2-8963-42a5-ab2f-ccfe81f8ab02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:27.214334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25b520e2-8963-42a5-ab2f-ccfe81f8ab02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:27.247718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-25b520e2-8963-42a5-ab2f-ccfe81f8ab02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 Dec 15 16:36:27.248297 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 666/1544] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:27 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:27.865864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f9fbaa18-ad7c-4a60-92e7-18d92486d819 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:27.866627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f9fbaa18-ad7c-4a60-92e7-18d92486d819 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:27.873541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa18-ad7c-4a60-92e7-18d92486d819 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:27.873980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa18-ad7c-4a60-92e7-18d92486d819 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:27.874757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa18-ad7c-4a60-92e7-18d92486d819 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:27.875186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa18-ad7c-4a60-92e7-18d92486d819 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:28.046163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f9fbaa18-ad7c-4a60-92e7-18d92486d819 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:28.054803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f9fbaa18-ad7c-4a60-92e7-18d92486d819 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.192725 Dec 15 16:36:28.055375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 879/1545] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:28.259927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-582cc97e-a7f4-4701-84f8-2541d4204f4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:28.260875 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-582cc97e-a7f4-4701-84f8-2541d4204f4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:28.267864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-582cc97e-a7f4-4701-84f8-2541d4204f4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:28.268317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-582cc97e-a7f4-4701-84f8-2541d4204f4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:28.269154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-582cc97e-a7f4-4701-84f8-2541d4204f4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:28.269594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-582cc97e-a7f4-4701-84f8-2541d4204f4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:28.302699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-582cc97e-a7f4-4701-84f8-2541d4204f4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 Dec 15 16:36:28.303259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 667/1546] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:29.072108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4aa41a33-4fb4-4ee5-a507-3c77b1ffb941 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:29.072764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4aa41a33-4fb4-4ee5-a507-3c77b1ffb941 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:29.079551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4aa41a33-4fb4-4ee5-a507-3c77b1ffb941 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:29.080027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4aa41a33-4fb4-4ee5-a507-3c77b1ffb941 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:29.080820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4aa41a33-4fb4-4ee5-a507-3c77b1ffb941 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:29.081254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4aa41a33-4fb4-4ee5-a507-3c77b1ffb941 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:29.225402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4aa41a33-4fb4-4ee5-a507-3c77b1ffb941 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:29.233720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4aa41a33-4fb4-4ee5-a507-3c77b1ffb941 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.165398 Dec 15 16:36:29.234285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 880/1547] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:29.315339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-53ec5c38-b8de-4c19-8cb1-d8bbaac243b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:29.316247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-53ec5c38-b8de-4c19-8cb1-d8bbaac243b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:29.323223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53ec5c38-b8de-4c19-8cb1-d8bbaac243b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:29.323598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53ec5c38-b8de-4c19-8cb1-d8bbaac243b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:29.324381 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53ec5c38-b8de-4c19-8cb1-d8bbaac243b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:29.324846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53ec5c38-b8de-4c19-8cb1-d8bbaac243b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:29.354782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-53ec5c38-b8de-4c19-8cb1-d8bbaac243b5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043292 Dec 15 16:36:29.355340 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 668/1548] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:30.250288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-57062bed-61f5-44e7-95ae-e5d02d6b5559 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:30.250872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-57062bed-61f5-44e7-95ae-e5d02d6b5559 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:30.257900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57062bed-61f5-44e7-95ae-e5d02d6b5559 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:30.258364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57062bed-61f5-44e7-95ae-e5d02d6b5559 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:30.259153 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57062bed-61f5-44e7-95ae-e5d02d6b5559 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:30.259591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57062bed-61f5-44e7-95ae-e5d02d6b5559 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:30.368150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-687477ac-af2d-4a7a-8cc6-4f2101981066 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:30.369209 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-687477ac-af2d-4a7a-8cc6-4f2101981066 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:30.376415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-687477ac-af2d-4a7a-8cc6-4f2101981066 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:30.376843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-687477ac-af2d-4a7a-8cc6-4f2101981066 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:30.377623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-687477ac-af2d-4a7a-8cc6-4f2101981066 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:30.378054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-687477ac-af2d-4a7a-8cc6-4f2101981066 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:30.401348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-57062bed-61f5-44e7-95ae-e5d02d6b5559 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:30.408662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-687477ac-af2d-4a7a-8cc6-4f2101981066 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045719 Dec 15 16:36:30.408825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-57062bed-61f5-44e7-95ae-e5d02d6b5559 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.162278 Dec 15 16:36:30.409240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 669/1549] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:30.409350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 881/1550] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:30 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:31.420590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ce978e6d-4475-4211-956b-4bc462d0cc73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:31.422166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ce978e6d-4475-4211-956b-4bc462d0cc73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:31.425417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a51ea459-30fd-4fb7-90ec-2a6551b11be0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:31.426030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a51ea459-30fd-4fb7-90ec-2a6551b11be0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:31.428966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ce978e6d-4475-4211-956b-4bc462d0cc73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:31.429922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ce978e6d-4475-4211-956b-4bc462d0cc73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:31.430754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ce978e6d-4475-4211-956b-4bc462d0cc73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:31.431189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ce978e6d-4475-4211-956b-4bc462d0cc73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:31.433041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a51ea459-30fd-4fb7-90ec-2a6551b11be0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:31.433493 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a51ea459-30fd-4fb7-90ec-2a6551b11be0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:31.434281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a51ea459-30fd-4fb7-90ec-2a6551b11be0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:31.434712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a51ea459-30fd-4fb7-90ec-2a6551b11be0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:31.462700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ce978e6d-4475-4211-956b-4bc462d0cc73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045986 Dec 15 16:36:31.463280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 670/1551] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:31.570559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a51ea459-30fd-4fb7-90ec-2a6551b11be0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:31.578259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a51ea459-30fd-4fb7-90ec-2a6551b11be0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.156456 Dec 15 16:36:31.578826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 882/1552] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:31 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:32.476592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ac7d0c3f-e690-4af9-8f8d-37be7b0fc827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:32.477508 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ac7d0c3f-e690-4af9-8f8d-37be7b0fc827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:32.485229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ac7d0c3f-e690-4af9-8f8d-37be7b0fc827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:32.485731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ac7d0c3f-e690-4af9-8f8d-37be7b0fc827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:32.486608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ac7d0c3f-e690-4af9-8f8d-37be7b0fc827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:32.487095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ac7d0c3f-e690-4af9-8f8d-37be7b0fc827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:32.518907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ac7d0c3f-e690-4af9-8f8d-37be7b0fc827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Dec 15 16:36:32.519466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 671/1553] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:32.598098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3511c8f7-ae89-4b57-8e66-d9cfecbb9141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:32.598731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3511c8f7-ae89-4b57-8e66-d9cfecbb9141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:32.606158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3511c8f7-ae89-4b57-8e66-d9cfecbb9141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:32.606603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3511c8f7-ae89-4b57-8e66-d9cfecbb9141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:32.607390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3511c8f7-ae89-4b57-8e66-d9cfecbb9141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:32.607820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3511c8f7-ae89-4b57-8e66-d9cfecbb9141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:32.753609 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3511c8f7-ae89-4b57-8e66-d9cfecbb9141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:32.763971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3511c8f7-ae89-4b57-8e66-d9cfecbb9141 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.171891 Dec 15 16:36:32.764746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 883/1554] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:33.531082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a72a1bd0-2775-490b-a1df-4906b059ff07 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:33.531895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a72a1bd0-2775-490b-a1df-4906b059ff07 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:33.538980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a72a1bd0-2775-490b-a1df-4906b059ff07 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:33.539533 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a72a1bd0-2775-490b-a1df-4906b059ff07 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:33.540482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a72a1bd0-2775-490b-a1df-4906b059ff07 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:33.540938 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a72a1bd0-2775-490b-a1df-4906b059ff07 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:33.571634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a72a1bd0-2775-490b-a1df-4906b059ff07 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Dec 15 16:36:33.572294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 672/1555] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:33 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:33.790509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-815bb172-25e5-4da0-bd8d-af47ab1e47aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:33.791086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-815bb172-25e5-4da0-bd8d-af47ab1e47aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:33.797768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-815bb172-25e5-4da0-bd8d-af47ab1e47aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:33.798210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-815bb172-25e5-4da0-bd8d-af47ab1e47aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:33.798987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-815bb172-25e5-4da0-bd8d-af47ab1e47aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:33.799411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-815bb172-25e5-4da0-bd8d-af47ab1e47aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:34.009465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-815bb172-25e5-4da0-bd8d-af47ab1e47aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:34.020221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-815bb172-25e5-4da0-bd8d-af47ab1e47aa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.233318 Dec 15 16:36:34.021127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 884/1556] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:34.583307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e1fa6fdf-c6a9-433f-9339-e2f307c48cb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:34.584225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e1fa6fdf-c6a9-433f-9339-e2f307c48cb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:34.591105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1fa6fdf-c6a9-433f-9339-e2f307c48cb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:34.591550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1fa6fdf-c6a9-433f-9339-e2f307c48cb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:34.592716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1fa6fdf-c6a9-433f-9339-e2f307c48cb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:34.593154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1fa6fdf-c6a9-433f-9339-e2f307c48cb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:34.623419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e1fa6fdf-c6a9-433f-9339-e2f307c48cb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Dec 15 16:36:34.623938 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 673/1557] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:35.042850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-77e57a53-b819-4e71-b9f1-35ea412e55dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:35.043420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-77e57a53-b819-4e71-b9f1-35ea412e55dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:35.050488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77e57a53-b819-4e71-b9f1-35ea412e55dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:35.050956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77e57a53-b819-4e71-b9f1-35ea412e55dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:35.051736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77e57a53-b819-4e71-b9f1-35ea412e55dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:35.052165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77e57a53-b819-4e71-b9f1-35ea412e55dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:35.204937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-77e57a53-b819-4e71-b9f1-35ea412e55dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:35.215286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-77e57a53-b819-4e71-b9f1-35ea412e55dc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.176293 Dec 15 16:36:35.215875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 885/1558] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:35.637869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-425a14a2-1645-4dac-8955-8fcf431d7938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:35.638771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-425a14a2-1645-4dac-8955-8fcf431d7938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:35.645591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-425a14a2-1645-4dac-8955-8fcf431d7938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:35.646052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-425a14a2-1645-4dac-8955-8fcf431d7938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:35.646821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-425a14a2-1645-4dac-8955-8fcf431d7938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:35.647248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-425a14a2-1645-4dac-8955-8fcf431d7938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:35.678788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-425a14a2-1645-4dac-8955-8fcf431d7938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Dec 15 16:36:35.679348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 674/1559] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:36.236808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f5fa53ff-bfbf-4bf4-938c-306431af1978 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:36.237739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f5fa53ff-bfbf-4bf4-938c-306431af1978 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:36.246430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5fa53ff-bfbf-4bf4-938c-306431af1978 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:36.246883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5fa53ff-bfbf-4bf4-938c-306431af1978 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:36.247680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5fa53ff-bfbf-4bf4-938c-306431af1978 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:36.248114 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5fa53ff-bfbf-4bf4-938c-306431af1978 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:36.393877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f5fa53ff-bfbf-4bf4-938c-306431af1978 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:36.402512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f5fa53ff-bfbf-4bf4-938c-306431af1978 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.171876 Dec 15 16:36:36.403057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 886/1560] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:36 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:36.693580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d974d544-c21f-4964-bec3-8fa26f174282 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:36.694827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d974d544-c21f-4964-bec3-8fa26f174282 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:36.704940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d974d544-c21f-4964-bec3-8fa26f174282 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:36.705630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d974d544-c21f-4964-bec3-8fa26f174282 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:36.706832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d974d544-c21f-4964-bec3-8fa26f174282 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:36.707495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d974d544-c21f-4964-bec3-8fa26f174282 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:36.738617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d974d544-c21f-4964-bec3-8fa26f174282 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051140 Dec 15 16:36:36.739185 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 675/1561] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:37.419559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bba56814-8755-4d80-a372-6be8a98dbd85 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:37.420139 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bba56814-8755-4d80-a372-6be8a98dbd85 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:37.426854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bba56814-8755-4d80-a372-6be8a98dbd85 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:37.427294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bba56814-8755-4d80-a372-6be8a98dbd85 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:37.428072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bba56814-8755-4d80-a372-6be8a98dbd85 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:37.428532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bba56814-8755-4d80-a372-6be8a98dbd85 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:37.594595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bba56814-8755-4d80-a372-6be8a98dbd85 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:37.606401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bba56814-8755-4d80-a372-6be8a98dbd85 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.190567 Dec 15 16:36:37.607220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 887/1562] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:37 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:37.753632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7324ff39-0beb-4a4a-8f6c-e4d0910c1105 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:37.754546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7324ff39-0beb-4a4a-8f6c-e4d0910c1105 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:37.763618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7324ff39-0beb-4a4a-8f6c-e4d0910c1105 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:37.764239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7324ff39-0beb-4a4a-8f6c-e4d0910c1105 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:37.765415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7324ff39-0beb-4a4a-8f6c-e4d0910c1105 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:37.766035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7324ff39-0beb-4a4a-8f6c-e4d0910c1105 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:37.797866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7324ff39-0beb-4a4a-8f6c-e4d0910c1105 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050251 Dec 15 16:36:37.798410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 676/1563] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:38.627973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8c52b0f8-76db-4a45-84f0-1018295471c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:38.628596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8c52b0f8-76db-4a45-84f0-1018295471c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:38.635546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8c52b0f8-76db-4a45-84f0-1018295471c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:38.635992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8c52b0f8-76db-4a45-84f0-1018295471c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:38.636808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8c52b0f8-76db-4a45-84f0-1018295471c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:38.637236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8c52b0f8-76db-4a45-84f0-1018295471c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:38.781763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8c52b0f8-76db-4a45-84f0-1018295471c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:38.790232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8c52b0f8-76db-4a45-84f0-1018295471c0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.166042 Dec 15 16:36:38.790807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 888/1564] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:38.811482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-869f44bd-a64b-4556-8f63-61818d1e44f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:38.812386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-869f44bd-a64b-4556-8f63-61818d1e44f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:38.819223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-869f44bd-a64b-4556-8f63-61818d1e44f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:38.819674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-869f44bd-a64b-4556-8f63-61818d1e44f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:38.820454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-869f44bd-a64b-4556-8f63-61818d1e44f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:38.822826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-869f44bd-a64b-4556-8f63-61818d1e44f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:38.857611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-869f44bd-a64b-4556-8f63-61818d1e44f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049884 Dec 15 16:36:38.858189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 677/1565] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:39.808360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-acb40aba-3ec4-4e36-bbf9-dec7176debff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:39.809014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-acb40aba-3ec4-4e36-bbf9-dec7176debff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:39.815950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-acb40aba-3ec4-4e36-bbf9-dec7176debff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:39.816451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-acb40aba-3ec4-4e36-bbf9-dec7176debff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:39.817210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-acb40aba-3ec4-4e36-bbf9-dec7176debff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:39.817654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-acb40aba-3ec4-4e36-bbf9-dec7176debff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:39.869627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1f46ab12-b515-4227-85b9-88281e2836c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:39.870546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1f46ab12-b515-4227-85b9-88281e2836c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:39.877288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f46ab12-b515-4227-85b9-88281e2836c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:39.877750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f46ab12-b515-4227-85b9-88281e2836c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:39.878590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f46ab12-b515-4227-85b9-88281e2836c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:39.879022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1f46ab12-b515-4227-85b9-88281e2836c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:39.910432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1f46ab12-b515-4227-85b9-88281e2836c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Dec 15 16:36:39.911082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 678/1566] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:39 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:39.953352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-acb40aba-3ec4-4e36-bbf9-dec7176debff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:39.963980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-acb40aba-3ec4-4e36-bbf9-dec7176debff tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.159626 Dec 15 16:36:39.964584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 889/1567] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:40.923087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-23e619ba-ddf0-4b30-8635-639c043a40ab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:40.924168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-23e619ba-ddf0-4b30-8635-639c043a40ab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:40.933856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23e619ba-ddf0-4b30-8635-639c043a40ab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:40.935639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23e619ba-ddf0-4b30-8635-639c043a40ab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:40.936894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23e619ba-ddf0-4b30-8635-639c043a40ab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:40.937611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23e619ba-ddf0-4b30-8635-639c043a40ab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:40.971995 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-23e619ba-ddf0-4b30-8635-639c043a40ab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053110 Dec 15 16:36:40.972622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 679/1568] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:40.983969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-99b853ff-d28f-4c72-a55d-2f5cbf944614 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:40.984803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-99b853ff-d28f-4c72-a55d-2f5cbf944614 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:40.994028 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b853ff-d28f-4c72-a55d-2f5cbf944614 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:40.994861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b853ff-d28f-4c72-a55d-2f5cbf944614 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:40.996187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b853ff-d28f-4c72-a55d-2f5cbf944614 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:40.996900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99b853ff-d28f-4c72-a55d-2f5cbf944614 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:41.147984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-99b853ff-d28f-4c72-a55d-2f5cbf944614 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:41.157528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-99b853ff-d28f-4c72-a55d-2f5cbf944614 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.178959 Dec 15 16:36:41.158142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 890/1569] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:40 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:41.983623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b0ebc9d3-2bc0-47e7-a389-09618c0f6cb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:41.984557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b0ebc9d3-2bc0-47e7-a389-09618c0f6cb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:41.991518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b0ebc9d3-2bc0-47e7-a389-09618c0f6cb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:41.991962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b0ebc9d3-2bc0-47e7-a389-09618c0f6cb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:41.992888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b0ebc9d3-2bc0-47e7-a389-09618c0f6cb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:41.993382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b0ebc9d3-2bc0-47e7-a389-09618c0f6cb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:42.024372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b0ebc9d3-2bc0-47e7-a389-09618c0f6cb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Dec 15 16:36:42.024993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 680/1570] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:42.181718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-163bd7c4-8a59-4dda-bf7c-3abc4ab4746c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:42.182328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-163bd7c4-8a59-4dda-bf7c-3abc4ab4746c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:42.189128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-163bd7c4-8a59-4dda-bf7c-3abc4ab4746c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:42.189566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-163bd7c4-8a59-4dda-bf7c-3abc4ab4746c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:42.190349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-163bd7c4-8a59-4dda-bf7c-3abc4ab4746c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:42.190782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-163bd7c4-8a59-4dda-bf7c-3abc4ab4746c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:42.339826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-163bd7c4-8a59-4dda-bf7c-3abc4ab4746c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:42.352645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-163bd7c4-8a59-4dda-bf7c-3abc4ab4746c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.175875 Dec 15 16:36:42.353188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 891/1571] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:42 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:43.038128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-de417e58-3bbb-4501-adbf-4ae879523fa0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:43.039034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-de417e58-3bbb-4501-adbf-4ae879523fa0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:43.046478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de417e58-3bbb-4501-adbf-4ae879523fa0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:43.046940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de417e58-3bbb-4501-adbf-4ae879523fa0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:43.047721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de417e58-3bbb-4501-adbf-4ae879523fa0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:43.048150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de417e58-3bbb-4501-adbf-4ae879523fa0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:43.084857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-de417e58-3bbb-4501-adbf-4ae879523fa0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050512 Dec 15 16:36:43.085415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 681/1572] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:43.371596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e29ceb52-12bf-4261-b570-fe299c8b7748 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:43.372230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e29ceb52-12bf-4261-b570-fe299c8b7748 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:43.378781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e29ceb52-12bf-4261-b570-fe299c8b7748 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:43.379233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e29ceb52-12bf-4261-b570-fe299c8b7748 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:43.380017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e29ceb52-12bf-4261-b570-fe299c8b7748 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:43.380462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e29ceb52-12bf-4261-b570-fe299c8b7748 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:43.525772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e29ceb52-12bf-4261-b570-fe299c8b7748 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:43.533414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e29ceb52-12bf-4261-b570-fe299c8b7748 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.166860 Dec 15 16:36:43.534012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 892/1573] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:43 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:44.079425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c1508ef3-2418-44a5-9553-d7cc72eb6b63 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:44.079938 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c1508ef3-2418-44a5-9553-d7cc72eb6b63 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:44.086421 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1508ef3-2418-44a5-9553-d7cc72eb6b63 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:44.086868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1508ef3-2418-44a5-9553-d7cc72eb6b63 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:44.087647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1508ef3-2418-44a5-9553-d7cc72eb6b63 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:44.088076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c1508ef3-2418-44a5-9553-d7cc72eb6b63 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:44.098855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3ec13b78-fc0c-4830-abb4-5e51cf8a36db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:44.099759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3ec13b78-fc0c-4830-abb4-5e51cf8a36db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:44.106083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ec13b78-fc0c-4830-abb4-5e51cf8a36db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:44.106532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ec13b78-fc0c-4830-abb4-5e51cf8a36db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:44.107325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ec13b78-fc0c-4830-abb4-5e51cf8a36db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:44.107759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ec13b78-fc0c-4830-abb4-5e51cf8a36db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:44.114196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c1508ef3-2418-44a5-9553-d7cc72eb6b63 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Going to try to terminate instance {{(pid=116022) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:36:44.138449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3ec13b78-fc0c-4830-abb4-5e51cf8a36db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043248 Dec 15 16:36:44.139031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 893/1574] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:36:44.196811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c1508ef3-2418-44a5-9553-d7cc72eb6b63 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 204 len: 0 microversion: 2.1 time: 0.212099 Dec 15 16:36:44.197502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 682/1575] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:36:43 2021] DELETE /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:36:44.205715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3fe6b0a6-2aef-41a8-8247-05a8e030b5b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:44.206330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3fe6b0a6-2aef-41a8-8247-05a8e030b5b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:44.212357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fe6b0a6-2aef-41a8-8247-05a8e030b5b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:44.212869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fe6b0a6-2aef-41a8-8247-05a8e030b5b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:44.213643 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fe6b0a6-2aef-41a8-8247-05a8e030b5b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:44.214077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fe6b0a6-2aef-41a8-8247-05a8e030b5b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:44.369442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3fe6b0a6-2aef-41a8-8247-05a8e030b5b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:44.377908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3fe6b0a6-2aef-41a8-8247-05a8e030b5b5 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1513 microversion: 2.1 time: 0.175883 Dec 15 16:36:44.378528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 894/1576] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:44 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:44.554388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7b29266e-ecbb-4ec9-91fb-5a0c36c022df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:44.555432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7b29266e-ecbb-4ec9-91fb-5a0c36c022df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:44.563090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b29266e-ecbb-4ec9-91fb-5a0c36c022df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:44.563516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b29266e-ecbb-4ec9-91fb-5a0c36c022df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:44.564322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b29266e-ecbb-4ec9-91fb-5a0c36c022df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:44.564812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b29266e-ecbb-4ec9-91fb-5a0c36c022df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:44.718325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7b29266e-ecbb-4ec9-91fb-5a0c36c022df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:44.731354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7b29266e-ecbb-4ec9-91fb-5a0c36c022df tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.183073 Dec 15 16:36:44.732264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 683/1577] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:45.150156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c4b369e2-3b8e-4cf3-a021-687376744a42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:45.151078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c4b369e2-3b8e-4cf3-a021-687376744a42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:45.157605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c4b369e2-3b8e-4cf3-a021-687376744a42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:45.158060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c4b369e2-3b8e-4cf3-a021-687376744a42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:45.158883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c4b369e2-3b8e-4cf3-a021-687376744a42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:45.159322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c4b369e2-3b8e-4cf3-a021-687376744a42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:45.190707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c4b369e2-3b8e-4cf3-a021-687376744a42 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Dec 15 16:36:45.191265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 895/1578] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:45.399603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-52f812b3-ef4f-4004-ac17-51dd0abc0913 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:45.400181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-52f812b3-ef4f-4004-ac17-51dd0abc0913 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:45.407478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-52f812b3-ef4f-4004-ac17-51dd0abc0913 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:45.407927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-52f812b3-ef4f-4004-ac17-51dd0abc0913 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:45.408756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-52f812b3-ef4f-4004-ac17-51dd0abc0913 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:45.409189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-52f812b3-ef4f-4004-ac17-51dd0abc0913 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:45.559624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-52f812b3-ef4f-4004-ac17-51dd0abc0913 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:45.567634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-52f812b3-ef4f-4004-ac17-51dd0abc0913 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1513 microversion: 2.1 time: 0.171925 Dec 15 16:36:45.568213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 684/1579] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:45 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:45.755418 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-66dcbb47-1d00-4100-a599-f76183b0f798 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:45.756323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-66dcbb47-1d00-4100-a599-f76183b0f798 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:45.763532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66dcbb47-1d00-4100-a599-f76183b0f798 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:45.763985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66dcbb47-1d00-4100-a599-f76183b0f798 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:45.764811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66dcbb47-1d00-4100-a599-f76183b0f798 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:45.765243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66dcbb47-1d00-4100-a599-f76183b0f798 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:46.202398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-19bfd4fd-1b11-4c6c-b00c-5410067c671b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:46.203397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-19bfd4fd-1b11-4c6c-b00c-5410067c671b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:46.209313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-19bfd4fd-1b11-4c6c-b00c-5410067c671b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:46.209752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-19bfd4fd-1b11-4c6c-b00c-5410067c671b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:46.210531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-19bfd4fd-1b11-4c6c-b00c-5410067c671b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:46.210957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-19bfd4fd-1b11-4c6c-b00c-5410067c671b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:46.226423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-66dcbb47-1d00-4100-a599-f76183b0f798 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:46.235337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-66dcbb47-1d00-4100-a599-f76183b0f798 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.483929 Dec 15 16:36:46.236276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 896/1580] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:46.241415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-19bfd4fd-1b11-4c6c-b00c-5410067c671b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042865 Dec 15 16:36:46.242163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 685/1581] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:46.347922 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-a8dd1ed7-9877-47d4-96e3-bcc56d7214c1 req-32005bb6-ddbd-4e13-b271-58821ca26f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eaeeee0-0df6-446b-86cb-5048272ae551", "name": "network-vif-deleted", "tag": "9d0d6033-d810-4f90-92fa-b1c3f8ebe691"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:36:46.350183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:36:46.350183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:36:46.358126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-a8dd1ed7-9877-47d4-96e3-bcc56d7214c1 req-32005bb6-ddbd-4e13-b271-58821ca26f87 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:46.358642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-a8dd1ed7-9877-47d4-96e3-bcc56d7214c1 req-32005bb6-ddbd-4e13-b271-58821ca26f87 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:46.371040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-a8dd1ed7-9877-47d4-96e3-bcc56d7214c1 req-32005bb6-ddbd-4e13-b271-58821ca26f87 service nova] Creating event network-vif-deleted:9d0d6033-d810-4f90-92fa-b1c3f8ebe691 for instance 6eaeeee0-0df6-446b-86cb-5048272ae551 on hv-cinder-82002 Dec 15 16:36:46.376297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-a8dd1ed7-9877-47d4-96e3-bcc56d7214c1 req-32005bb6-ddbd-4e13-b271-58821ca26f87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031996 Dec 15 16:36:46.377203 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 897/1582] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:36:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:46.588935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:46.589736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:46.599626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:46.600306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:46.601600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:46.602307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:46.636293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:46.636872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:46.637441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lazy-loading 'fault' on Instance uuid 6eaeeee0-0df6-446b-86cb-5048272ae551 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:36:46.685571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:46.693071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5470c001-9a58-44d2-b128-c0872c2408e0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 200 len: 1308 microversion: 2.1 time: 0.110131 Dec 15 16:36:46.693638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 686/1583] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:46 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:47.253164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-27bb1933-4d08-4c7f-aa32-8e1d15bee2ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:47.254061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bee89737-d99a-408c-bcae-52e26e012002 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:47.254547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-27bb1933-4d08-4c7f-aa32-8e1d15bee2ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:47.254736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bee89737-d99a-408c-bcae-52e26e012002 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:47.260617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27bb1933-4d08-4c7f-aa32-8e1d15bee2ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.261052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27bb1933-4d08-4c7f-aa32-8e1d15bee2ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:47.261238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bee89737-d99a-408c-bcae-52e26e012002 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.261720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bee89737-d99a-408c-bcae-52e26e012002 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:47.261846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27bb1933-4d08-4c7f-aa32-8e1d15bee2ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.262339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27bb1933-4d08-4c7f-aa32-8e1d15bee2ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:47.262967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bee89737-d99a-408c-bcae-52e26e012002 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.263409 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bee89737-d99a-408c-bcae-52e26e012002 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:47.291840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-27bb1933-4d08-4c7f-aa32-8e1d15bee2ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042420 Dec 15 16:36:47.292418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 687/1584] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:47 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:36:47.398143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bee89737-d99a-408c-bcae-52e26e012002 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:47.405790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bee89737-d99a-408c-bcae-52e26e012002 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.156204 Dec 15 16:36:47.406363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 898/1585] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:47.711789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4cbaeec0-82ab-4bae-8935-545d9518311c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:47.712606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4cbaeec0-82ab-4bae-8935-545d9518311c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 6eaeeee0-0df6-446b-86cb-5048272ae551] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:47.720237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cbaeec0-82ab-4bae-8935-545d9518311c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.720725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cbaeec0-82ab-4bae-8935-545d9518311c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:47.721522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cbaeec0-82ab-4bae-8935-545d9518311c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.721959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4cbaeec0-82ab-4bae-8935-545d9518311c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:47.735751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-4cbaeec0-82ab-4bae-8935-545d9518311c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] HTTP exception thrown: Instance 6eaeeee0-0df6-446b-86cb-5048272ae551 could not be found. Dec 15 16:36:47.736357 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4cbaeec0-82ab-4bae-8935-545d9518311c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Returning 404 to user: Instance 6eaeeee0-0df6-446b-86cb-5048272ae551 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:36:47.737239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4cbaeec0-82ab-4bae-8935-545d9518311c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551" status: 404 len: 111 microversion: 2.1 time: 0.030317 Dec 15 16:36:47.737789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 688/1586] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:47 2021] GET /compute/v2.1/servers/6eaeeee0-0df6-446b-86cb-5048272ae551 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:36:47.748145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e5e407a4-97ef-483c-99c6-deb7539d4e90 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:47.748841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5e407a4-97ef-483c-99c6-deb7539d4e90 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:47.755278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e407a4-97ef-483c-99c6-deb7539d4e90 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.755722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e407a4-97ef-483c-99c6-deb7539d4e90 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:47.756566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e407a4-97ef-483c-99c6-deb7539d4e90 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.756979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5e407a4-97ef-483c-99c6-deb7539d4e90 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:47.788876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5e407a4-97ef-483c-99c6-deb7539d4e90 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:36:47.868169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e5e407a4-97ef-483c-99c6-deb7539d4e90 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 204 len: 0 microversion: 2.1 time: 0.125255 Dec 15 16:36:47.868805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 899/1587] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:36:47 2021] DELETE /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:36:47.878266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9cdee938-cab5-4a85-b377-a754198f435c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:47.879191 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9cdee938-cab5-4a85-b377-a754198f435c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:47.888537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9cdee938-cab5-4a85-b377-a754198f435c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.888976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9cdee938-cab5-4a85-b377-a754198f435c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:47.889784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9cdee938-cab5-4a85-b377-a754198f435c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:47.890209 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9cdee938-cab5-4a85-b377-a754198f435c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:48.030549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9cdee938-cab5-4a85-b377-a754198f435c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:48.038285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9cdee938-cab5-4a85-b377-a754198f435c tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1512 microversion: 2.1 time: 0.164262 Dec 15 16:36:48.038841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 689/1588] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:47 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:48.305544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-47a25e67-d7f3-4fe6-928f-27856c7349aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:48.306458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-47a25e67-d7f3-4fe6-928f-27856c7349aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:48.314149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47a25e67-d7f3-4fe6-928f-27856c7349aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:48.314590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47a25e67-d7f3-4fe6-928f-27856c7349aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:48.315378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47a25e67-d7f3-4fe6-928f-27856c7349aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:48.315811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47a25e67-d7f3-4fe6-928f-27856c7349aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:48.348364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-47a25e67-d7f3-4fe6-928f-27856c7349aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047544 Dec 15 16:36:48.348973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 900/1589] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:48.423372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e26988bd-3dfe-419f-b028-1400a75afe74 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:48.423986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e26988bd-3dfe-419f-b028-1400a75afe74 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:48.430472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e26988bd-3dfe-419f-b028-1400a75afe74 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:48.430913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e26988bd-3dfe-419f-b028-1400a75afe74 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:48.431691 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e26988bd-3dfe-419f-b028-1400a75afe74 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:48.432115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e26988bd-3dfe-419f-b028-1400a75afe74 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:48.582032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e26988bd-3dfe-419f-b028-1400a75afe74 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:48.594429 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e26988bd-3dfe-419f-b028-1400a75afe74 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.174856 Dec 15 16:36:48.595352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 690/1590] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:49.056371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5c8f9053-dabe-461d-8390-283db870af1e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:49.057014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5c8f9053-dabe-461d-8390-283db870af1e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:49.063492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c8f9053-dabe-461d-8390-283db870af1e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:49.063935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c8f9053-dabe-461d-8390-283db870af1e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:49.064780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c8f9053-dabe-461d-8390-283db870af1e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:49.065212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c8f9053-dabe-461d-8390-283db870af1e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:49.206531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5c8f9053-dabe-461d-8390-283db870af1e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:49.214655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5c8f9053-dabe-461d-8390-283db870af1e tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1512 microversion: 2.1 time: 0.162070 Dec 15 16:36:49.215227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 901/1591] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:49 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:49.362598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-de4dd1fb-2b8e-4c6b-914b-80bf28b189b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:49.363496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-de4dd1fb-2b8e-4c6b-914b-80bf28b189b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:49.370161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de4dd1fb-2b8e-4c6b-914b-80bf28b189b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:49.370729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de4dd1fb-2b8e-4c6b-914b-80bf28b189b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:49.371512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de4dd1fb-2b8e-4c6b-914b-80bf28b189b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:49.371942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de4dd1fb-2b8e-4c6b-914b-80bf28b189b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:49.404509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-de4dd1fb-2b8e-4c6b-914b-80bf28b189b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 Dec 15 16:36:49.405109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 691/1592] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:49.615278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f46076b1-3559-4fea-a128-a2d0f45b1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:49.615871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f46076b1-3559-4fea-a128-a2d0f45b1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:49.622166 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f46076b1-3559-4fea-a128-a2d0f45b1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:49.622666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f46076b1-3559-4fea-a128-a2d0f45b1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:49.623482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f46076b1-3559-4fea-a128-a2d0f45b1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:49.623891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f46076b1-3559-4fea-a128-a2d0f45b1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:49.749162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-77d27a8b-2b28-40fc-9003-307cbe9e8ddf req-7d7dd02e-2311-4312-a5ef-fb6c92d96c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a35326-63a8-445f-8588-d8d7c424c441", "name": "network-vif-deleted", "tag": "dc256b5e-6441-4373-885f-e17238e5274c"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:36:49.751380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:36:49.751380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:36:49.759146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-77d27a8b-2b28-40fc-9003-307cbe9e8ddf req-7d7dd02e-2311-4312-a5ef-fb6c92d96c7f service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:49.759589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-77d27a8b-2b28-40fc-9003-307cbe9e8ddf req-7d7dd02e-2311-4312-a5ef-fb6c92d96c7f service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:49.772206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-77d27a8b-2b28-40fc-9003-307cbe9e8ddf req-7d7dd02e-2311-4312-a5ef-fb6c92d96c7f service nova] Creating event network-vif-deleted:dc256b5e-6441-4373-885f-e17238e5274c for instance f8a35326-63a8-445f-8588-d8d7c424c441 on hv-cinder-82002 Dec 15 16:36:49.778747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-77d27a8b-2b28-40fc-9003-307cbe9e8ddf req-7d7dd02e-2311-4312-a5ef-fb6c92d96c7f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033201 Dec 15 16:36:49.779871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 692/1593] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:36:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:36:49.829670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f46076b1-3559-4fea-a128-a2d0f45b1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:49.838758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f46076b1-3559-4fea-a128-a2d0f45b1969 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.227313 Dec 15 16:36:49.840508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 902/1594] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:49 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:50.232537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:50.233667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:50.240672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:50.241137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:50.241923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:50.242389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:50.275382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:50.275728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:50.276176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.objects.instance [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lazy-loading 'fault' on Instance uuid f8a35326-63a8-445f-8588-d8d7c424c441 {{(pid=116022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:36:50.316817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:50.323725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4a9304f6-7da8-4186-a95f-9e80a51afcfb tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 200 len: 1307 microversion: 2.1 time: 0.095681 Dec 15 16:36:50.324307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 693/1595] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:50 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:50.418424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2c845beb-1bc9-4670-82db-37263cc1fcde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:50.419892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2c845beb-1bc9-4670-82db-37263cc1fcde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:50.426445 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2c845beb-1bc9-4670-82db-37263cc1fcde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:50.426895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2c845beb-1bc9-4670-82db-37263cc1fcde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:50.427689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2c845beb-1bc9-4670-82db-37263cc1fcde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:50.428124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2c845beb-1bc9-4670-82db-37263cc1fcde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:50.459915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2c845beb-1bc9-4670-82db-37263cc1fcde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047951 Dec 15 16:36:50.460632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 903/1596] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:50.859468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f03e54a5-67d8-46f7-8283-8afd27a122fa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:50.860066 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f03e54a5-67d8-46f7-8283-8afd27a122fa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:50.867058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f03e54a5-67d8-46f7-8283-8afd27a122fa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:50.867501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f03e54a5-67d8-46f7-8283-8afd27a122fa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:50.868292 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f03e54a5-67d8-46f7-8283-8afd27a122fa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:50.868764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f03e54a5-67d8-46f7-8283-8afd27a122fa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:51.019014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f03e54a5-67d8-46f7-8283-8afd27a122fa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:51.027221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f03e54a5-67d8-46f7-8283-8afd27a122fa tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.173158 Dec 15 16:36:51.027767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 694/1597] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:50 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:51.341829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-71fabb91-cf95-4cdb-a82e-34bde1c1965a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:51.342818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-71fabb91-cf95-4cdb-a82e-34bde1c1965a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: f8a35326-63a8-445f-8588-d8d7c424c441] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:51.349842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71fabb91-cf95-4cdb-a82e-34bde1c1965a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:51.350285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71fabb91-cf95-4cdb-a82e-34bde1c1965a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:51.351063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71fabb91-cf95-4cdb-a82e-34bde1c1965a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:51.351489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71fabb91-cf95-4cdb-a82e-34bde1c1965a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:51.365474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-71fabb91-cf95-4cdb-a82e-34bde1c1965a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] HTTP exception thrown: Instance f8a35326-63a8-445f-8588-d8d7c424c441 could not be found. Dec 15 16:36:51.366050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-71fabb91-cf95-4cdb-a82e-34bde1c1965a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Returning 404 to user: Instance f8a35326-63a8-445f-8588-d8d7c424c441 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:36:51.366891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-71fabb91-cf95-4cdb-a82e-34bde1c1965a tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441" status: 404 len: 111 microversion: 2.1 time: 0.029199 Dec 15 16:36:51.367426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 904/1598] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:51 2021] GET /compute/v2.1/servers/f8a35326-63a8-445f-8588-d8d7c424c441 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:36:51.475315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d961528a-f32a-4f8e-997b-d28d22b91ee4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:51.476139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d961528a-f32a-4f8e-997b-d28d22b91ee4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:51.484115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d961528a-f32a-4f8e-997b-d28d22b91ee4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:51.484601 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d961528a-f32a-4f8e-997b-d28d22b91ee4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:51.485392 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d961528a-f32a-4f8e-997b-d28d22b91ee4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:51.485818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d961528a-f32a-4f8e-997b-d28d22b91ee4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:51.517114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d961528a-f32a-4f8e-997b-d28d22b91ee4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047139 Dec 15 16:36:51.517676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 695/1599] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:52.044902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-28ef10f6-ce86-41bb-a6bd-95e90a14b189 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:52.045537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-28ef10f6-ce86-41bb-a6bd-95e90a14b189 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:52.052046 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28ef10f6-ce86-41bb-a6bd-95e90a14b189 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:52.052522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28ef10f6-ce86-41bb-a6bd-95e90a14b189 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:52.053342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28ef10f6-ce86-41bb-a6bd-95e90a14b189 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:52.053762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28ef10f6-ce86-41bb-a6bd-95e90a14b189 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:52.191899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-28ef10f6-ce86-41bb-a6bd-95e90a14b189 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:52.203356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-28ef10f6-ce86-41bb-a6bd-95e90a14b189 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.162003 Dec 15 16:36:52.204201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 905/1600] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:52.530242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-635ff357-1d59-4d82-8d44-b8159f091d09 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:52.531449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-635ff357-1d59-4d82-8d44-b8159f091d09 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:52.541141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-635ff357-1d59-4d82-8d44-b8159f091d09 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:52.541815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-635ff357-1d59-4d82-8d44-b8159f091d09 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:52.542917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-635ff357-1d59-4d82-8d44-b8159f091d09 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:52.543374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-635ff357-1d59-4d82-8d44-b8159f091d09 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:52.574876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-635ff357-1d59-4d82-8d44-b8159f091d09 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049905 Dec 15 16:36:52.575499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 696/1601] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:53.227115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1ce461f8-3cf1-40c8-a7ba-a327a3a3c529 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:53.227944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1ce461f8-3cf1-40c8-a7ba-a327a3a3c529 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:53.235186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ce461f8-3cf1-40c8-a7ba-a327a3a3c529 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:53.235639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ce461f8-3cf1-40c8-a7ba-a327a3a3c529 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:53.236460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ce461f8-3cf1-40c8-a7ba-a327a3a3c529 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:53.236915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ce461f8-3cf1-40c8-a7ba-a327a3a3c529 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:53.384797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1ce461f8-3cf1-40c8-a7ba-a327a3a3c529 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:53.394798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1ce461f8-3cf1-40c8-a7ba-a327a3a3c529 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.171674 Dec 15 16:36:53.395598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 906/1602] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:53 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:53.586879 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b3665b06-3904-401b-8382-b5f6883f7b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:53.587795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b3665b06-3904-401b-8382-b5f6883f7b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:53.595337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b3665b06-3904-401b-8382-b5f6883f7b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:53.595810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b3665b06-3904-401b-8382-b5f6883f7b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:53.596640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b3665b06-3904-401b-8382-b5f6883f7b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:53.597076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b3665b06-3904-401b-8382-b5f6883f7b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:53.627003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b3665b06-3904-401b-8382-b5f6883f7b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 Dec 15 16:36:53.627560 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 697/1603] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:53 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:54.420621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5acfcf04-631b-495c-b594-ebd88ec08799 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:54.421235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5acfcf04-631b-495c-b594-ebd88ec08799 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:54.428161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5acfcf04-631b-495c-b594-ebd88ec08799 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:54.428664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5acfcf04-631b-495c-b594-ebd88ec08799 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:54.429493 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5acfcf04-631b-495c-b594-ebd88ec08799 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:54.429944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5acfcf04-631b-495c-b594-ebd88ec08799 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:54.584833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5acfcf04-631b-495c-b594-ebd88ec08799 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:54.593999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5acfcf04-631b-495c-b594-ebd88ec08799 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.179726 Dec 15 16:36:54.594574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 907/1604] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:54 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:54.641495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b9c2faf1-c0b9-48e7-b18d-101255287de6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:54.642399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b9c2faf1-c0b9-48e7-b18d-101255287de6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:54.649733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9c2faf1-c0b9-48e7-b18d-101255287de6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:54.650176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9c2faf1-c0b9-48e7-b18d-101255287de6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:54.650973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9c2faf1-c0b9-48e7-b18d-101255287de6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:54.651407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9c2faf1-c0b9-48e7-b18d-101255287de6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:54.682906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b9c2faf1-c0b9-48e7-b18d-101255287de6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046738 Dec 15 16:36:54.683369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 698/1605] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:54 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:55.611796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c81ce791-67dd-4bbb-beea-505afa41ff33 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:55.612394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c81ce791-67dd-4bbb-beea-505afa41ff33 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:55.619160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c81ce791-67dd-4bbb-beea-505afa41ff33 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:55.619605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c81ce791-67dd-4bbb-beea-505afa41ff33 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:55.620393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c81ce791-67dd-4bbb-beea-505afa41ff33 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:55.620857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c81ce791-67dd-4bbb-beea-505afa41ff33 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:55.694730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-86d8aa8b-036a-4701-a79c-3e32b5426990 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:55.695660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-86d8aa8b-036a-4701-a79c-3e32b5426990 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:55.702301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-86d8aa8b-036a-4701-a79c-3e32b5426990 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:55.702791 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-86d8aa8b-036a-4701-a79c-3e32b5426990 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:55.703575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-86d8aa8b-036a-4701-a79c-3e32b5426990 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:55.704010 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-86d8aa8b-036a-4701-a79c-3e32b5426990 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:55.734866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-86d8aa8b-036a-4701-a79c-3e32b5426990 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 Dec 15 16:36:55.735429 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 699/1606] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:55.764906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c81ce791-67dd-4bbb-beea-505afa41ff33 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:55.772727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c81ce791-67dd-4bbb-beea-505afa41ff33 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.164883 Dec 15 16:36:55.773214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 908/1607] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:56.747469 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-65f2c673-47e2-41a8-aa90-c03058491184 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:56.748372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-65f2c673-47e2-41a8-aa90-c03058491184 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:56.755291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65f2c673-47e2-41a8-aa90-c03058491184 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:56.755743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65f2c673-47e2-41a8-aa90-c03058491184 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:56.756572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65f2c673-47e2-41a8-aa90-c03058491184 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:56.757059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-65f2c673-47e2-41a8-aa90-c03058491184 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:56.787746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-65f2c673-47e2-41a8-aa90-c03058491184 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Dec 15 16:36:56.788316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 700/1608] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:56.790269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dca790f9-c4ee-4650-8409-a5c7773e05d1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:56.790924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dca790f9-c4ee-4650-8409-a5c7773e05d1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:56.798328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dca790f9-c4ee-4650-8409-a5c7773e05d1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:56.798775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dca790f9-c4ee-4650-8409-a5c7773e05d1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:56.799561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dca790f9-c4ee-4650-8409-a5c7773e05d1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:56.800040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dca790f9-c4ee-4650-8409-a5c7773e05d1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:56.945456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dca790f9-c4ee-4650-8409-a5c7773e05d1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:56.953606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dca790f9-c4ee-4650-8409-a5c7773e05d1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.167055 Dec 15 16:36:56.954192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 909/1609] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:57.800554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-67863a45-9d83-44e3-a1e6-d9e884b7f03e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:57.801474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-67863a45-9d83-44e3-a1e6-d9e884b7f03e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:57.808178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67863a45-9d83-44e3-a1e6-d9e884b7f03e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:57.808738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67863a45-9d83-44e3-a1e6-d9e884b7f03e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:57.809528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67863a45-9d83-44e3-a1e6-d9e884b7f03e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:57.809961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67863a45-9d83-44e3-a1e6-d9e884b7f03e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:57.840598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-67863a45-9d83-44e3-a1e6-d9e884b7f03e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044064 Dec 15 16:36:57.841163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 701/1610] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:57.971789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-00fb9bf3-13a7-4671-9c4b-d61d963b1377 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:57.972422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-00fb9bf3-13a7-4671-9c4b-d61d963b1377 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:57.979433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00fb9bf3-13a7-4671-9c4b-d61d963b1377 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:57.979879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00fb9bf3-13a7-4671-9c4b-d61d963b1377 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:57.980777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00fb9bf3-13a7-4671-9c4b-d61d963b1377 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:57.981129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00fb9bf3-13a7-4671-9c4b-d61d963b1377 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:58.118847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00fb9bf3-13a7-4671-9c4b-d61d963b1377 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:58.127573 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-00fb9bf3-13a7-4671-9c4b-d61d963b1377 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.159710 Dec 15 16:36:58.128156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 910/1611] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:58.856869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ccd7d8d2-f568-4428-aff5-57c0293bc019 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:58.858285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ccd7d8d2-f568-4428-aff5-57c0293bc019 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:58.870335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccd7d8d2-f568-4428-aff5-57c0293bc019 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:58.870898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccd7d8d2-f568-4428-aff5-57c0293bc019 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:58.871883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccd7d8d2-f568-4428-aff5-57c0293bc019 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:58.872424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccd7d8d2-f568-4428-aff5-57c0293bc019 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:58.905219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ccd7d8d2-f568-4428-aff5-57c0293bc019 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054672 Dec 15 16:36:58.905788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 702/1612] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:36:59.145844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e89ca4f3-f395-48b6-b22a-053ad8466308 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:59.146446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e89ca4f3-f395-48b6-b22a-053ad8466308 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:59.153110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e89ca4f3-f395-48b6-b22a-053ad8466308 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:59.153570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e89ca4f3-f395-48b6-b22a-053ad8466308 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:59.154363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e89ca4f3-f395-48b6-b22a-053ad8466308 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:59.154792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e89ca4f3-f395-48b6-b22a-053ad8466308 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:59.306969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e89ca4f3-f395-48b6-b22a-053ad8466308 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:36:59.315660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e89ca4f3-f395-48b6-b22a-053ad8466308 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.173568 Dec 15 16:36:59.316301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 911/1613] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:36:59 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:36:59.917636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fd63cb48-d560-41be-86ff-75bfbd0e886c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:36:59.918602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fd63cb48-d560-41be-86ff-75bfbd0e886c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:36:59.926944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fd63cb48-d560-41be-86ff-75bfbd0e886c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:59.927925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fd63cb48-d560-41be-86ff-75bfbd0e886c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:59.929044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fd63cb48-d560-41be-86ff-75bfbd0e886c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:36:59.929710 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fd63cb48-d560-41be-86ff-75bfbd0e886c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:36:59.966136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fd63cb48-d560-41be-86ff-75bfbd0e886c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052441 Dec 15 16:36:59.967074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 703/1614] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:36:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:00.333881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ba01b88c-0a50-4264-ba19-a957536ca5d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:00.334519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ba01b88c-0a50-4264-ba19-a957536ca5d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:00.341299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba01b88c-0a50-4264-ba19-a957536ca5d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:00.342078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba01b88c-0a50-4264-ba19-a957536ca5d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:00.342883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba01b88c-0a50-4264-ba19-a957536ca5d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:00.343312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba01b88c-0a50-4264-ba19-a957536ca5d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:00.491044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ba01b88c-0a50-4264-ba19-a957536ca5d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:00.503227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ba01b88c-0a50-4264-ba19-a957536ca5d0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.173196 Dec 15 16:37:00.503923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 912/1615] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:00.981590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a678473c-529e-47ce-ae3e-0bbb4dd40e9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:00.982669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a678473c-529e-47ce-ae3e-0bbb4dd40e9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:00.991613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a678473c-529e-47ce-ae3e-0bbb4dd40e9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:00.992092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a678473c-529e-47ce-ae3e-0bbb4dd40e9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:00.992968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a678473c-529e-47ce-ae3e-0bbb4dd40e9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:00.993400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a678473c-529e-47ce-ae3e-0bbb4dd40e9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:01.028440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a678473c-529e-47ce-ae3e-0bbb4dd40e9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053067 Dec 15 16:37:01.029029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 704/1616] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:01.528016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-35e6e21e-0623-43b3-8953-26eb269c0535 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:01.528703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-35e6e21e-0623-43b3-8953-26eb269c0535 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:01.538948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35e6e21e-0623-43b3-8953-26eb269c0535 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:01.539371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35e6e21e-0623-43b3-8953-26eb269c0535 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:01.540483 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35e6e21e-0623-43b3-8953-26eb269c0535 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:01.541073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-35e6e21e-0623-43b3-8953-26eb269c0535 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:01.688825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-35e6e21e-0623-43b3-8953-26eb269c0535 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:01.696723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-35e6e21e-0623-43b3-8953-26eb269c0535 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.174319 Dec 15 16:37:01.697315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 913/1617] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:02.040416 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a2eb8da9-c011-435a-8237-bff4aa800587 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:02.041350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a2eb8da9-c011-435a-8237-bff4aa800587 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:02.048448 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a2eb8da9-c011-435a-8237-bff4aa800587 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:02.048885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a2eb8da9-c011-435a-8237-bff4aa800587 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:02.049659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a2eb8da9-c011-435a-8237-bff4aa800587 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:02.050089 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a2eb8da9-c011-435a-8237-bff4aa800587 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:02.080054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a2eb8da9-c011-435a-8237-bff4aa800587 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043322 Dec 15 16:37:02.080823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 705/1618] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:02.717544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f201c017-6f82-4ad2-a194-d4d1f1debcc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:02.718220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f201c017-6f82-4ad2-a194-d4d1f1debcc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:02.727106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f201c017-6f82-4ad2-a194-d4d1f1debcc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:02.727588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f201c017-6f82-4ad2-a194-d4d1f1debcc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:02.728755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f201c017-6f82-4ad2-a194-d4d1f1debcc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:02.729288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f201c017-6f82-4ad2-a194-d4d1f1debcc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:02.880237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f201c017-6f82-4ad2-a194-d4d1f1debcc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:02.891415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f201c017-6f82-4ad2-a194-d4d1f1debcc6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.179210 Dec 15 16:37:02.892147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 914/1619] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:03.094601 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e731486b-fef6-4492-b75e-c6e8fc5e8201 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:03.095601 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e731486b-fef6-4492-b75e-c6e8fc5e8201 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:03.102352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e731486b-fef6-4492-b75e-c6e8fc5e8201 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:03.102800 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e731486b-fef6-4492-b75e-c6e8fc5e8201 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:03.103581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e731486b-fef6-4492-b75e-c6e8fc5e8201 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:03.104011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e731486b-fef6-4492-b75e-c6e8fc5e8201 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:03.134171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e731486b-fef6-4492-b75e-c6e8fc5e8201 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Dec 15 16:37:03.134735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 706/1620] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:03.914563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a0f25ff3-d58d-4394-9c90-0777d5125849 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:03.915790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a0f25ff3-d58d-4394-9c90-0777d5125849 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:03.922757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0f25ff3-d58d-4394-9c90-0777d5125849 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:03.923194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0f25ff3-d58d-4394-9c90-0777d5125849 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:03.924237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0f25ff3-d58d-4394-9c90-0777d5125849 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:03.924694 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0f25ff3-d58d-4394-9c90-0777d5125849 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:04.069524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a0f25ff3-d58d-4394-9c90-0777d5125849 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:04.077841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a0f25ff3-d58d-4394-9c90-0777d5125849 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.166987 Dec 15 16:37:04.078736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 915/1621] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:03 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:04.146252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-61757bee-e82e-48f9-af50-72a415cb9f17 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:04.147170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-61757bee-e82e-48f9-af50-72a415cb9f17 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:04.153792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61757bee-e82e-48f9-af50-72a415cb9f17 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:04.154270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61757bee-e82e-48f9-af50-72a415cb9f17 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:04.155048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61757bee-e82e-48f9-af50-72a415cb9f17 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:04.155478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61757bee-e82e-48f9-af50-72a415cb9f17 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:04.185402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-61757bee-e82e-48f9-af50-72a415cb9f17 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043095 Dec 15 16:37:04.185957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 707/1622] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:04 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:05.095840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3ab85ce1-caa6-43c3-b200-e9f6c0796458 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:05.096491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3ab85ce1-caa6-43c3-b200-e9f6c0796458 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:05.102963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ab85ce1-caa6-43c3-b200-e9f6c0796458 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:05.103411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ab85ce1-caa6-43c3-b200-e9f6c0796458 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:05.104198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ab85ce1-caa6-43c3-b200-e9f6c0796458 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:05.104667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ab85ce1-caa6-43c3-b200-e9f6c0796458 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:05.198414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-92d41e36-2f42-4377-b9fc-ae7c3136cee8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:05.199341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-92d41e36-2f42-4377-b9fc-ae7c3136cee8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:05.206905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92d41e36-2f42-4377-b9fc-ae7c3136cee8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:05.207713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92d41e36-2f42-4377-b9fc-ae7c3136cee8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:05.208779 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92d41e36-2f42-4377-b9fc-ae7c3136cee8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:05.209537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92d41e36-2f42-4377-b9fc-ae7c3136cee8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:05.241374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-92d41e36-2f42-4377-b9fc-ae7c3136cee8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Dec 15 16:37:05.241970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 708/1623] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:05.251625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3ab85ce1-caa6-43c3-b200-e9f6c0796458 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:05.259417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3ab85ce1-caa6-43c3-b200-e9f6c0796458 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.167894 Dec 15 16:37:05.260015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 916/1624] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:06.254941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a9bcbe3b-351a-4006-98db-0dce93f1e4b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:06.255858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a9bcbe3b-351a-4006-98db-0dce93f1e4b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:06.262787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9bcbe3b-351a-4006-98db-0dce93f1e4b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:06.263233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9bcbe3b-351a-4006-98db-0dce93f1e4b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:06.264068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9bcbe3b-351a-4006-98db-0dce93f1e4b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:06.264470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9bcbe3b-351a-4006-98db-0dce93f1e4b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:06.276424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-21808293-50cf-4f57-9b28-1aabe51931b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:06.277051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-21808293-50cf-4f57-9b28-1aabe51931b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:06.284182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21808293-50cf-4f57-9b28-1aabe51931b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:06.284643 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21808293-50cf-4f57-9b28-1aabe51931b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:06.285470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21808293-50cf-4f57-9b28-1aabe51931b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:06.285899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21808293-50cf-4f57-9b28-1aabe51931b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:06.296724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a9bcbe3b-351a-4006-98db-0dce93f1e4b2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045922 Dec 15 16:37:06.297305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 709/1625] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:06.433653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-21808293-50cf-4f57-9b28-1aabe51931b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:06.443391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-21808293-50cf-4f57-9b28-1aabe51931b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.170677 Dec 15 16:37:06.443964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 917/1626] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:07.308904 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5b6b0b53-a24e-4a36-9707-e5950a2edcb1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:07.309843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5b6b0b53-a24e-4a36-9707-e5950a2edcb1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:07.316599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b6b0b53-a24e-4a36-9707-e5950a2edcb1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:07.317043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b6b0b53-a24e-4a36-9707-e5950a2edcb1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:07.317824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b6b0b53-a24e-4a36-9707-e5950a2edcb1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:07.318251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b6b0b53-a24e-4a36-9707-e5950a2edcb1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:07.350356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5b6b0b53-a24e-4a36-9707-e5950a2edcb1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Dec 15 16:37:07.350914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 710/1627] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:07.462956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c20c32e1-f298-497b-adbd-e5b6261d15ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:07.463568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c20c32e1-f298-497b-adbd-e5b6261d15ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:07.474125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c20c32e1-f298-497b-adbd-e5b6261d15ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:07.474712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c20c32e1-f298-497b-adbd-e5b6261d15ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:07.475863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c20c32e1-f298-497b-adbd-e5b6261d15ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:07.476304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c20c32e1-f298-497b-adbd-e5b6261d15ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:07.625617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c20c32e1-f298-497b-adbd-e5b6261d15ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:07.634487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c20c32e1-f298-497b-adbd-e5b6261d15ed tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.177213 Dec 15 16:37:07.635065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 918/1628] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:07 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:08.362626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7e25a28e-8da4-43e7-ab8c-0f38ae37006e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:08.363676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7e25a28e-8da4-43e7-ab8c-0f38ae37006e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:08.371352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7e25a28e-8da4-43e7-ab8c-0f38ae37006e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:08.371856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7e25a28e-8da4-43e7-ab8c-0f38ae37006e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:08.372693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7e25a28e-8da4-43e7-ab8c-0f38ae37006e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:08.373124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7e25a28e-8da4-43e7-ab8c-0f38ae37006e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:08.404981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7e25a28e-8da4-43e7-ab8c-0f38ae37006e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Dec 15 16:37:08.405557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 711/1629] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:08.652654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-76952bd9-377a-49a1-8f54-bdea54f11e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:08.653323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-76952bd9-377a-49a1-8f54-bdea54f11e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:08.661617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76952bd9-377a-49a1-8f54-bdea54f11e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:08.662342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76952bd9-377a-49a1-8f54-bdea54f11e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:08.663130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76952bd9-377a-49a1-8f54-bdea54f11e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:08.664155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76952bd9-377a-49a1-8f54-bdea54f11e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:08.808915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-76952bd9-377a-49a1-8f54-bdea54f11e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:08.816653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-76952bd9-377a-49a1-8f54-bdea54f11e25 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1448 microversion: 2.1 time: 0.168186 Dec 15 16:37:08.817558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 919/1630] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:09.345875 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-d7b45076-8292-4b24-b1aa-189cdbc83ca5 req-08d4bdba-891e-4f58-bc46-32d0c9b205ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4fd848-09ba-42aa-9176-dc8a60b95be2", "name": "network-vif-deleted", "tag": "2c61efe0-6ed5-4b49-8a66-8e9f491633d4"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:37:09.348058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:37:09.348058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:37:09.356775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-d7b45076-8292-4b24-b1aa-189cdbc83ca5 req-08d4bdba-891e-4f58-bc46-32d0c9b205ba service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:09.357310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-d7b45076-8292-4b24-b1aa-189cdbc83ca5 req-08d4bdba-891e-4f58-bc46-32d0c9b205ba service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:09.371803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-d7b45076-8292-4b24-b1aa-189cdbc83ca5 req-08d4bdba-891e-4f58-bc46-32d0c9b205ba service nova] Creating event network-vif-deleted:2c61efe0-6ed5-4b49-8a66-8e9f491633d4 for instance 4c4fd848-09ba-42aa-9176-dc8a60b95be2 on hv-cinder-82002 Dec 15 16:37:09.379009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-d7b45076-8292-4b24-b1aa-189cdbc83ca5 req-08d4bdba-891e-4f58-bc46-32d0c9b205ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037577 Dec 15 16:37:09.380171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 712/1631] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:37:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:37:09.417044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d7cf1856-a7dd-4ed4-b3a2-5cf99be5424e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:09.418221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d7cf1856-a7dd-4ed4-b3a2-5cf99be5424e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:09.425516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d7cf1856-a7dd-4ed4-b3a2-5cf99be5424e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:09.426033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d7cf1856-a7dd-4ed4-b3a2-5cf99be5424e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:09.426856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d7cf1856-a7dd-4ed4-b3a2-5cf99be5424e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:09.427464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d7cf1856-a7dd-4ed4-b3a2-5cf99be5424e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:09.458073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d7cf1856-a7dd-4ed4-b3a2-5cf99be5424e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Dec 15 16:37:09.458662 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 920/1632] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:09.836482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-194ff011-d400-47b1-ab47-a25133ac85e8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:09.837617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-194ff011-d400-47b1-ab47-a25133ac85e8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:09.844723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-194ff011-d400-47b1-ab47-a25133ac85e8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:09.845172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-194ff011-d400-47b1-ab47-a25133ac85e8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:09.845968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-194ff011-d400-47b1-ab47-a25133ac85e8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:09.846406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-194ff011-d400-47b1-ab47-a25133ac85e8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:09.919706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-194ff011-d400-47b1-ab47-a25133ac85e8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:09.929099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-194ff011-d400-47b1-ab47-a25133ac85e8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.098262 Dec 15 16:37:09.929740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 713/1633] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:10.471126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a18e541c-b6a0-428b-833b-8c0d81426d1f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:10.471953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a18e541c-b6a0-428b-833b-8c0d81426d1f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:10.478847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a18e541c-b6a0-428b-833b-8c0d81426d1f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:10.479297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a18e541c-b6a0-428b-833b-8c0d81426d1f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:10.480063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a18e541c-b6a0-428b-833b-8c0d81426d1f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:10.480562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a18e541c-b6a0-428b-833b-8c0d81426d1f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:10.513596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a18e541c-b6a0-428b-833b-8c0d81426d1f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046738 Dec 15 16:37:10.514173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 921/1634] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:10.951734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-00176e01-514a-4035-b510-9113ad40447a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:10.952405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-00176e01-514a-4035-b510-9113ad40447a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:10.960084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00176e01-514a-4035-b510-9113ad40447a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:10.960558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00176e01-514a-4035-b510-9113ad40447a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:10.961345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00176e01-514a-4035-b510-9113ad40447a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:10.961772 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00176e01-514a-4035-b510-9113ad40447a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:11.023374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-00176e01-514a-4035-b510-9113ad40447a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:11.031880 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-00176e01-514a-4035-b510-9113ad40447a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.084272 Dec 15 16:37:11.032476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 714/1635] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:11.525539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-22fed9ac-a93c-491d-8e87-1de2590e93e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:11.526600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-22fed9ac-a93c-491d-8e87-1de2590e93e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:11.533312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-22fed9ac-a93c-491d-8e87-1de2590e93e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:11.533744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-22fed9ac-a93c-491d-8e87-1de2590e93e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:11.534556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-22fed9ac-a93c-491d-8e87-1de2590e93e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:11.535010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-22fed9ac-a93c-491d-8e87-1de2590e93e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:11.567120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-22fed9ac-a93c-491d-8e87-1de2590e93e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Dec 15 16:37:11.567721 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 922/1636] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:12.053768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b8ef8bd0-2823-44c2-a83e-ce81b6608382 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:12.054383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b8ef8bd0-2823-44c2-a83e-ce81b6608382 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:12.061254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b8ef8bd0-2823-44c2-a83e-ce81b6608382 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:12.061694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b8ef8bd0-2823-44c2-a83e-ce81b6608382 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:12.062520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b8ef8bd0-2823-44c2-a83e-ce81b6608382 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:12.062915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b8ef8bd0-2823-44c2-a83e-ce81b6608382 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:12.126569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b8ef8bd0-2823-44c2-a83e-ce81b6608382 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:12.134717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b8ef8bd0-2823-44c2-a83e-ce81b6608382 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.084939 Dec 15 16:37:12.135292 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 715/1637] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:12 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:12.579320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0a9244a0-2337-4b00-b9c6-7378459170de tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:12.580227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0a9244a0-2337-4b00-b9c6-7378459170de tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:12.588509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a9244a0-2337-4b00-b9c6-7378459170de tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:12.589087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a9244a0-2337-4b00-b9c6-7378459170de tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:12.590163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a9244a0-2337-4b00-b9c6-7378459170de tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:12.590596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a9244a0-2337-4b00-b9c6-7378459170de tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:12.622569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0a9244a0-2337-4b00-b9c6-7378459170de tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Dec 15 16:37:12.623129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 923/1638] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:13.151427 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa2c7b73-6604-44f1-a037-e9782073ce40 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:13.152037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa2c7b73-6604-44f1-a037-e9782073ce40 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:13.160255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa2c7b73-6604-44f1-a037-e9782073ce40 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:13.160701 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa2c7b73-6604-44f1-a037-e9782073ce40 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:13.161506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa2c7b73-6604-44f1-a037-e9782073ce40 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:13.161933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa2c7b73-6604-44f1-a037-e9782073ce40 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:13.221958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa2c7b73-6604-44f1-a037-e9782073ce40 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:13.230049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa2c7b73-6604-44f1-a037-e9782073ce40 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.082346 Dec 15 16:37:13.230629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 716/1639] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:13.634312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dd814e73-1a21-4b2b-9b65-b495a99cd488 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:13.635882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dd814e73-1a21-4b2b-9b65-b495a99cd488 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:13.645414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd814e73-1a21-4b2b-9b65-b495a99cd488 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:13.646304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd814e73-1a21-4b2b-9b65-b495a99cd488 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:13.647486 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd814e73-1a21-4b2b-9b65-b495a99cd488 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:13.648050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd814e73-1a21-4b2b-9b65-b495a99cd488 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:13.682199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dd814e73-1a21-4b2b-9b65-b495a99cd488 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051704 Dec 15 16:37:13.682747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 924/1640] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:13 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:14.251233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ab7df080-a326-4ada-b747-c53bb650c6c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:14.252024 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ab7df080-a326-4ada-b747-c53bb650c6c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:14.259794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab7df080-a326-4ada-b747-c53bb650c6c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:14.260236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab7df080-a326-4ada-b747-c53bb650c6c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:14.261057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab7df080-a326-4ada-b747-c53bb650c6c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:14.261502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab7df080-a326-4ada-b747-c53bb650c6c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:14.327604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ab7df080-a326-4ada-b747-c53bb650c6c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:14.335390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ab7df080-a326-4ada-b747-c53bb650c6c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089210 Dec 15 16:37:14.335961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 717/1641] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:14.697848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6abf46d8-2cf5-41f6-a0ad-fd81e1b43306 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:14.698923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6abf46d8-2cf5-41f6-a0ad-fd81e1b43306 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:14.709245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6abf46d8-2cf5-41f6-a0ad-fd81e1b43306 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:14.709741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6abf46d8-2cf5-41f6-a0ad-fd81e1b43306 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:14.710666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6abf46d8-2cf5-41f6-a0ad-fd81e1b43306 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:14.711160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6abf46d8-2cf5-41f6-a0ad-fd81e1b43306 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:14.743940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6abf46d8-2cf5-41f6-a0ad-fd81e1b43306 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052328 Dec 15 16:37:14.744727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 925/1642] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:14 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:15.355972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9caf144e-3a03-4b80-9de0-50979250623f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:15.356586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9caf144e-3a03-4b80-9de0-50979250623f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:15.365693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9caf144e-3a03-4b80-9de0-50979250623f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:15.366138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9caf144e-3a03-4b80-9de0-50979250623f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:15.366928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9caf144e-3a03-4b80-9de0-50979250623f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:15.367356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9caf144e-3a03-4b80-9de0-50979250623f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:15.432228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9caf144e-3a03-4b80-9de0-50979250623f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:15.439963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9caf144e-3a03-4b80-9de0-50979250623f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089944 Dec 15 16:37:15.440567 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 718/1643] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:15.757516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-796a4ab1-6cab-43d7-83ed-97c9c329dd3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:15.758326 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-796a4ab1-6cab-43d7-83ed-97c9c329dd3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:15.765229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-796a4ab1-6cab-43d7-83ed-97c9c329dd3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:15.765678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-796a4ab1-6cab-43d7-83ed-97c9c329dd3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:15.766451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-796a4ab1-6cab-43d7-83ed-97c9c329dd3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:15.766876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-796a4ab1-6cab-43d7-83ed-97c9c329dd3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:15.796869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-796a4ab1-6cab-43d7-83ed-97c9c329dd3d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 Dec 15 16:37:15.797423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 926/1644] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:16.462372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-816ab0c6-3a09-46db-a558-3e2ab15ac938 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:16.462967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-816ab0c6-3a09-46db-a558-3e2ab15ac938 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:16.470080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-816ab0c6-3a09-46db-a558-3e2ab15ac938 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:16.470511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-816ab0c6-3a09-46db-a558-3e2ab15ac938 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:16.471321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-816ab0c6-3a09-46db-a558-3e2ab15ac938 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:16.471751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-816ab0c6-3a09-46db-a558-3e2ab15ac938 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:16.542916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-816ab0c6-3a09-46db-a558-3e2ab15ac938 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:16.552995 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-816ab0c6-3a09-46db-a558-3e2ab15ac938 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.094082 Dec 15 16:37:16.553705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 719/1645] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:16 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:16.809687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-44841f82-be3f-4332-912c-9fa9c0638ef3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:16.810627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-44841f82-be3f-4332-912c-9fa9c0638ef3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:16.818634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44841f82-be3f-4332-912c-9fa9c0638ef3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:16.819070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44841f82-be3f-4332-912c-9fa9c0638ef3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:16.819869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44841f82-be3f-4332-912c-9fa9c0638ef3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:16.820305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44841f82-be3f-4332-912c-9fa9c0638ef3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:16.851460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-44841f82-be3f-4332-912c-9fa9c0638ef3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045901 Dec 15 16:37:16.852011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 927/1646] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:16 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:17.578033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-abeac563-9e71-411f-8e39-d09f5fd1507a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:17.578826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-abeac563-9e71-411f-8e39-d09f5fd1507a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:17.587351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abeac563-9e71-411f-8e39-d09f5fd1507a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:17.587795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abeac563-9e71-411f-8e39-d09f5fd1507a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:17.588615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abeac563-9e71-411f-8e39-d09f5fd1507a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:17.589042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-abeac563-9e71-411f-8e39-d09f5fd1507a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:17.658344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-abeac563-9e71-411f-8e39-d09f5fd1507a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:17.666417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-abeac563-9e71-411f-8e39-d09f5fd1507a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.094307 Dec 15 16:37:17.667004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 720/1647] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:17 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:17.867441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1b998bab-c60f-4856-90a0-b990680e44ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:17.868395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1b998bab-c60f-4856-90a0-b990680e44ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:17.875320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b998bab-c60f-4856-90a0-b990680e44ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:17.875792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b998bab-c60f-4856-90a0-b990680e44ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:17.876617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b998bab-c60f-4856-90a0-b990680e44ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:17.877054 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b998bab-c60f-4856-90a0-b990680e44ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:17.908474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1b998bab-c60f-4856-90a0-b990680e44ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Dec 15 16:37:17.909257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 928/1648] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:18.689184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8c81f66b-a932-477d-8978-f7d63027e75e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:18.689839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8c81f66b-a932-477d-8978-f7d63027e75e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:18.699383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c81f66b-a932-477d-8978-f7d63027e75e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:18.700102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c81f66b-a932-477d-8978-f7d63027e75e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:18.701028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c81f66b-a932-477d-8978-f7d63027e75e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:18.701486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c81f66b-a932-477d-8978-f7d63027e75e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:18.764666 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8c81f66b-a932-477d-8978-f7d63027e75e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:18.772585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8c81f66b-a932-477d-8978-f7d63027e75e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089329 Dec 15 16:37:18.773161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 721/1649] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:18.922836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5e801b28-6b34-4cdc-a075-f2117a08ded3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:18.923849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5e801b28-6b34-4cdc-a075-f2117a08ded3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:18.931961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e801b28-6b34-4cdc-a075-f2117a08ded3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:18.932414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e801b28-6b34-4cdc-a075-f2117a08ded3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:18.933250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e801b28-6b34-4cdc-a075-f2117a08ded3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:18.933688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e801b28-6b34-4cdc-a075-f2117a08ded3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:18.963970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5e801b28-6b34-4cdc-a075-f2117a08ded3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046603 Dec 15 16:37:18.964444 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 929/1650] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:19.790231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6d3f4ce0-6a1c-4a7e-afdc-698e66a0fe76 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:19.790867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6d3f4ce0-6a1c-4a7e-afdc-698e66a0fe76 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:19.797598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6d3f4ce0-6a1c-4a7e-afdc-698e66a0fe76 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:19.798037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6d3f4ce0-6a1c-4a7e-afdc-698e66a0fe76 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:19.798792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6d3f4ce0-6a1c-4a7e-afdc-698e66a0fe76 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:19.799244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6d3f4ce0-6a1c-4a7e-afdc-698e66a0fe76 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:19.859382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6d3f4ce0-6a1c-4a7e-afdc-698e66a0fe76 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:19.867751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6d3f4ce0-6a1c-4a7e-afdc-698e66a0fe76 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.081340 Dec 15 16:37:19.868315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 722/1651] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:19.976627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c0305b75-979a-40c9-9103-85d74b56e1a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:19.977618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c0305b75-979a-40c9-9103-85d74b56e1a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:19.985001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0305b75-979a-40c9-9103-85d74b56e1a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:19.985512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0305b75-979a-40c9-9103-85d74b56e1a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:19.986429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0305b75-979a-40c9-9103-85d74b56e1a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:19.986972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0305b75-979a-40c9-9103-85d74b56e1a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:20.019304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c0305b75-979a-40c9-9103-85d74b56e1a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046686 Dec 15 16:37:20.019987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 930/1652] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:19 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:20.888933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-145bfd91-d95d-4c1b-a589-a0ea835f87b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:20.889847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-145bfd91-d95d-4c1b-a589-a0ea835f87b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:20.899553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-145bfd91-d95d-4c1b-a589-a0ea835f87b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:20.900005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-145bfd91-d95d-4c1b-a589-a0ea835f87b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:20.900834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-145bfd91-d95d-4c1b-a589-a0ea835f87b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:20.901266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-145bfd91-d95d-4c1b-a589-a0ea835f87b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:20.962953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-145bfd91-d95d-4c1b-a589-a0ea835f87b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:20.970932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-145bfd91-d95d-4c1b-a589-a0ea835f87b5 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.087871 Dec 15 16:37:20.971483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 723/1653] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:20 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:21.033395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-adc0eb84-a92b-42f7-bde5-a8baa4d745f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:21.034378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-adc0eb84-a92b-42f7-bde5-a8baa4d745f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:21.042162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-adc0eb84-a92b-42f7-bde5-a8baa4d745f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:21.042641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-adc0eb84-a92b-42f7-bde5-a8baa4d745f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:21.043429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-adc0eb84-a92b-42f7-bde5-a8baa4d745f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:21.043860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-adc0eb84-a92b-42f7-bde5-a8baa4d745f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:21.074336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-adc0eb84-a92b-42f7-bde5-a8baa4d745f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046881 Dec 15 16:37:21.074899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 931/1654] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:21.987924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-57d9f2bd-e03a-4ef4-8a53-b81278c99966 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:21.988720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-57d9f2bd-e03a-4ef4-8a53-b81278c99966 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:22.003251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57d9f2bd-e03a-4ef4-8a53-b81278c99966 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:22.003251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57d9f2bd-e03a-4ef4-8a53-b81278c99966 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:22.003251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57d9f2bd-e03a-4ef4-8a53-b81278c99966 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:22.003251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-57d9f2bd-e03a-4ef4-8a53-b81278c99966 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:22.071905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-57d9f2bd-e03a-4ef4-8a53-b81278c99966 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:22.083208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-57d9f2bd-e03a-4ef4-8a53-b81278c99966 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.099520 Dec 15 16:37:22.084020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 724/1655] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:22.087727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6cef0438-bbfd-432c-aec7-3bb62e4b23a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:22.088758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6cef0438-bbfd-432c-aec7-3bb62e4b23a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:22.095755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cef0438-bbfd-432c-aec7-3bb62e4b23a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:22.096151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cef0438-bbfd-432c-aec7-3bb62e4b23a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:22.096987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cef0438-bbfd-432c-aec7-3bb62e4b23a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:22.097425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cef0438-bbfd-432c-aec7-3bb62e4b23a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:22.128261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6cef0438-bbfd-432c-aec7-3bb62e4b23a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045526 Dec 15 16:37:22.128884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 932/1656] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:23.104171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-26e07894-ec20-4b2a-9195-b818c119e4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:23.104829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-26e07894-ec20-4b2a-9195-b818c119e4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:23.112823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26e07894-ec20-4b2a-9195-b818c119e4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:23.113319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26e07894-ec20-4b2a-9195-b818c119e4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:23.114163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26e07894-ec20-4b2a-9195-b818c119e4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:23.114589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26e07894-ec20-4b2a-9195-b818c119e4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:23.141233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-72345598-12a9-4661-b09b-8b48bd5bd238 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:23.142203 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-72345598-12a9-4661-b09b-8b48bd5bd238 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:23.149402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72345598-12a9-4661-b09b-8b48bd5bd238 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:23.149847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72345598-12a9-4661-b09b-8b48bd5bd238 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:23.150635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72345598-12a9-4661-b09b-8b48bd5bd238 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:23.151063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72345598-12a9-4661-b09b-8b48bd5bd238 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:23.180154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-26e07894-ec20-4b2a-9195-b818c119e4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:23.182275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-72345598-12a9-4661-b09b-8b48bd5bd238 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044818 Dec 15 16:37:23.183185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 933/1657] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:23 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:23.189599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-26e07894-ec20-4b2a-9195-b818c119e4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.090442 Dec 15 16:37:23.190398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 725/1658] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:23 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:24.196643 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-94839e77-cc9b-45c8-93b4-0ebef49949d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:24.197574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-94839e77-cc9b-45c8-93b4-0ebef49949d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:24.204606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94839e77-cc9b-45c8-93b4-0ebef49949d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:24.205066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94839e77-cc9b-45c8-93b4-0ebef49949d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:24.205869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94839e77-cc9b-45c8-93b4-0ebef49949d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:24.206302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94839e77-cc9b-45c8-93b4-0ebef49949d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:24.211206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-386750d3-18ad-45bb-822d-20fe3c0154f2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:24.212550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-386750d3-18ad-45bb-822d-20fe3c0154f2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:24.219835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-386750d3-18ad-45bb-822d-20fe3c0154f2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:24.220276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-386750d3-18ad-45bb-822d-20fe3c0154f2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:24.221110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-386750d3-18ad-45bb-822d-20fe3c0154f2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:24.221512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-386750d3-18ad-45bb-822d-20fe3c0154f2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:24.239884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-94839e77-cc9b-45c8-93b4-0ebef49949d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048625 Dec 15 16:37:24.240706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 934/1659] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:24 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:24.285433 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-386750d3-18ad-45bb-822d-20fe3c0154f2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:24.293262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-386750d3-18ad-45bb-822d-20fe3c0154f2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.085775 Dec 15 16:37:24.293837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 726/1660] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:25.252929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ab06f93c-a3c7-45d6-8625-211a3cb697f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:25.254035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ab06f93c-a3c7-45d6-8625-211a3cb697f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:25.261022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab06f93c-a3c7-45d6-8625-211a3cb697f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:25.261482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab06f93c-a3c7-45d6-8625-211a3cb697f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:25.262282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab06f93c-a3c7-45d6-8625-211a3cb697f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:25.262723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab06f93c-a3c7-45d6-8625-211a3cb697f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:25.293887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ab06f93c-a3c7-45d6-8625-211a3cb697f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Dec 15 16:37:25.294451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 935/1661] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:25 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:25.311307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-234dc60b-1a8a-4c95-ae55-e84bc2da6c1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:25.311922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-234dc60b-1a8a-4c95-ae55-e84bc2da6c1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:25.318606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-234dc60b-1a8a-4c95-ae55-e84bc2da6c1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:25.319052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-234dc60b-1a8a-4c95-ae55-e84bc2da6c1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:25.319836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-234dc60b-1a8a-4c95-ae55-e84bc2da6c1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:25.320264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-234dc60b-1a8a-4c95-ae55-e84bc2da6c1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:25.380705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-234dc60b-1a8a-4c95-ae55-e84bc2da6c1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:25.388548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-234dc60b-1a8a-4c95-ae55-e84bc2da6c1a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.081426 Dec 15 16:37:25.389093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 727/1662] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:26.308906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-78d6d5d6-ebc4-4c55-8551-33541123eddc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:26.309997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-78d6d5d6-ebc4-4c55-8551-33541123eddc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:26.319618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78d6d5d6-ebc4-4c55-8551-33541123eddc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:26.320253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78d6d5d6-ebc4-4c55-8551-33541123eddc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:26.321481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78d6d5d6-ebc4-4c55-8551-33541123eddc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:26.322139 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78d6d5d6-ebc4-4c55-8551-33541123eddc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:26.352384 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-78d6d5d6-ebc4-4c55-8551-33541123eddc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049266 Dec 15 16:37:26.352991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 936/1663] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:26.405633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c33a2f68-f02e-429a-a5dd-64b8d3418a1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:26.406179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c33a2f68-f02e-429a-a5dd-64b8d3418a1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:26.412910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c33a2f68-f02e-429a-a5dd-64b8d3418a1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:26.413364 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c33a2f68-f02e-429a-a5dd-64b8d3418a1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:26.414159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c33a2f68-f02e-429a-a5dd-64b8d3418a1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:26.414596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c33a2f68-f02e-429a-a5dd-64b8d3418a1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:26.487070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c33a2f68-f02e-429a-a5dd-64b8d3418a1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:26.497019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c33a2f68-f02e-429a-a5dd-64b8d3418a1e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.095221 Dec 15 16:37:26.497597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 728/1664] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:26 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:27.363600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-73820aba-1dee-48ba-8990-82f3234ca24e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:27.364532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-73820aba-1dee-48ba-8990-82f3234ca24e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:27.371655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73820aba-1dee-48ba-8990-82f3234ca24e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:27.372118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73820aba-1dee-48ba-8990-82f3234ca24e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:27.373005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73820aba-1dee-48ba-8990-82f3234ca24e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:27.373368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73820aba-1dee-48ba-8990-82f3234ca24e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:27.405884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-73820aba-1dee-48ba-8990-82f3234ca24e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046053 Dec 15 16:37:27.406452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 937/1665] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:27 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:27.514263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-649d0288-aa84-4717-965f-ddaa8d8ecf59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:27.514854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-649d0288-aa84-4717-965f-ddaa8d8ecf59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:27.522104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-649d0288-aa84-4717-965f-ddaa8d8ecf59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:27.522549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-649d0288-aa84-4717-965f-ddaa8d8ecf59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:27.523350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-649d0288-aa84-4717-965f-ddaa8d8ecf59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:27.523780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-649d0288-aa84-4717-965f-ddaa8d8ecf59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:27.590104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-649d0288-aa84-4717-965f-ddaa8d8ecf59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:27.598283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-649d0288-aa84-4717-965f-ddaa8d8ecf59 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.087802 Dec 15 16:37:27.598866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 729/1666] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:28.418793 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6d3a727a-00df-4bd2-8d12-11c64befb220 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:28.419617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6d3a727a-00df-4bd2-8d12-11c64befb220 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:28.426403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d3a727a-00df-4bd2-8d12-11c64befb220 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:28.426853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d3a727a-00df-4bd2-8d12-11c64befb220 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:28.427637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d3a727a-00df-4bd2-8d12-11c64befb220 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:28.428102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d3a727a-00df-4bd2-8d12-11c64befb220 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:28.458696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6d3a727a-00df-4bd2-8d12-11c64befb220 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 Dec 15 16:37:28.459256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 938/1667] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:28.615984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4b44d278-bd6d-4f4c-a191-ac752e124a73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:28.616644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4b44d278-bd6d-4f4c-a191-ac752e124a73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:28.623621 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b44d278-bd6d-4f4c-a191-ac752e124a73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:28.624062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b44d278-bd6d-4f4c-a191-ac752e124a73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:28.624951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b44d278-bd6d-4f4c-a191-ac752e124a73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:28.625378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b44d278-bd6d-4f4c-a191-ac752e124a73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:28.696133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4b44d278-bd6d-4f4c-a191-ac752e124a73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:28.707754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4b44d278-bd6d-4f4c-a191-ac752e124a73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.095243 Dec 15 16:37:28.708537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 730/1668] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:29.471697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4d2c1d81-718d-45b8-b07d-6da4e594e315 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:29.472529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4d2c1d81-718d-45b8-b07d-6da4e594e315 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:29.479451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d2c1d81-718d-45b8-b07d-6da4e594e315 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:29.479899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d2c1d81-718d-45b8-b07d-6da4e594e315 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:29.480818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d2c1d81-718d-45b8-b07d-6da4e594e315 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:29.481278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4d2c1d81-718d-45b8-b07d-6da4e594e315 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:29.512549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4d2c1d81-718d-45b8-b07d-6da4e594e315 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Dec 15 16:37:29.513050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 939/1669] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:29.728289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8d909ca2-287b-47ce-a58b-1823b351b37e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:29.728889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8d909ca2-287b-47ce-a58b-1823b351b37e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:29.737344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8d909ca2-287b-47ce-a58b-1823b351b37e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:29.737935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8d909ca2-287b-47ce-a58b-1823b351b37e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:29.739029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8d909ca2-287b-47ce-a58b-1823b351b37e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:29.739464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8d909ca2-287b-47ce-a58b-1823b351b37e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:29.804886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8d909ca2-287b-47ce-a58b-1823b351b37e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:29.816705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8d909ca2-287b-47ce-a58b-1823b351b37e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.091860 Dec 15 16:37:29.817539 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 731/1670] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:30.523703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-27bb5e18-3832-4ac0-a316-2618eb970759 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:30.524637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-27bb5e18-3832-4ac0-a316-2618eb970759 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:30.531413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27bb5e18-3832-4ac0-a316-2618eb970759 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:30.531856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27bb5e18-3832-4ac0-a316-2618eb970759 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:30.532694 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27bb5e18-3832-4ac0-a316-2618eb970759 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:30.533106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27bb5e18-3832-4ac0-a316-2618eb970759 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:30.564360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-27bb5e18-3832-4ac0-a316-2618eb970759 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Dec 15 16:37:30.564960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 940/1671] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:30.838757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8085a165-9e99-4278-8860-f227f7c96ea6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:30.839647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8085a165-9e99-4278-8860-f227f7c96ea6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:30.849482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8085a165-9e99-4278-8860-f227f7c96ea6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:30.850194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8085a165-9e99-4278-8860-f227f7c96ea6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:30.851322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8085a165-9e99-4278-8860-f227f7c96ea6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:30.851962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8085a165-9e99-4278-8860-f227f7c96ea6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:30.929945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8085a165-9e99-4278-8860-f227f7c96ea6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:30.940458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8085a165-9e99-4278-8860-f227f7c96ea6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.106989 Dec 15 16:37:30.941070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 732/1672] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:30 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:31.576284 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-538e7ffd-6889-4ab3-9d9a-fd1d5a50c938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:31.577254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-538e7ffd-6889-4ab3-9d9a-fd1d5a50c938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:31.584545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-538e7ffd-6889-4ab3-9d9a-fd1d5a50c938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:31.584984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-538e7ffd-6889-4ab3-9d9a-fd1d5a50c938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:31.585740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-538e7ffd-6889-4ab3-9d9a-fd1d5a50c938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:31.586189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-538e7ffd-6889-4ab3-9d9a-fd1d5a50c938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:31.616111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-538e7ffd-6889-4ab3-9d9a-fd1d5a50c938 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Dec 15 16:37:31.616916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 941/1673] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:31.960304 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-41d277db-33fe-44ba-b712-7f2079830a60 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:31.961491 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-41d277db-33fe-44ba-b712-7f2079830a60 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:31.971291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41d277db-33fe-44ba-b712-7f2079830a60 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:31.971984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41d277db-33fe-44ba-b712-7f2079830a60 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:31.972882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41d277db-33fe-44ba-b712-7f2079830a60 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:31.973321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41d277db-33fe-44ba-b712-7f2079830a60 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:32.041466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-41d277db-33fe-44ba-b712-7f2079830a60 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:32.052198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-41d277db-33fe-44ba-b712-7f2079830a60 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.097346 Dec 15 16:37:32.052927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 733/1674] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:31 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:32.630887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-39e6d7e7-0416-4ebc-80da-647c885109f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:32.632094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-39e6d7e7-0416-4ebc-80da-647c885109f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:32.641192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39e6d7e7-0416-4ebc-80da-647c885109f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:32.641836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39e6d7e7-0416-4ebc-80da-647c885109f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:32.642988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39e6d7e7-0416-4ebc-80da-647c885109f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:32.643619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-39e6d7e7-0416-4ebc-80da-647c885109f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:32.679122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-39e6d7e7-0416-4ebc-80da-647c885109f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054331 Dec 15 16:37:32.679697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 942/1675] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:33.073243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-63879db3-73da-4d8a-8c48-6904769dc789 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:33.073931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-63879db3-73da-4d8a-8c48-6904769dc789 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:33.080983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63879db3-73da-4d8a-8c48-6904769dc789 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:33.081431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63879db3-73da-4d8a-8c48-6904769dc789 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:33.082233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63879db3-73da-4d8a-8c48-6904769dc789 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:33.082660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-63879db3-73da-4d8a-8c48-6904769dc789 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:33.150619 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-63879db3-73da-4d8a-8c48-6904769dc789 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:33.158721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-63879db3-73da-4d8a-8c48-6904769dc789 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089295 Dec 15 16:37:33.159285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 734/1676] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:33.691429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2a2aed1a-ca08-4aea-9983-a6c08b486fb8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:33.692308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2a2aed1a-ca08-4aea-9983-a6c08b486fb8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:33.698791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2a2aed1a-ca08-4aea-9983-a6c08b486fb8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:33.699458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2a2aed1a-ca08-4aea-9983-a6c08b486fb8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:33.700742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2a2aed1a-ca08-4aea-9983-a6c08b486fb8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:33.701181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2a2aed1a-ca08-4aea-9983-a6c08b486fb8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:33.735787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2a2aed1a-ca08-4aea-9983-a6c08b486fb8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048030 Dec 15 16:37:33.736346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 943/1677] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:33 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:34.181353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-26da1ca2-3b1b-4347-a4d6-80159f70c2a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:34.181934 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-26da1ca2-3b1b-4347-a4d6-80159f70c2a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:34.188921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26da1ca2-3b1b-4347-a4d6-80159f70c2a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:34.189374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26da1ca2-3b1b-4347-a4d6-80159f70c2a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:34.190155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26da1ca2-3b1b-4347-a4d6-80159f70c2a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:34.190611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26da1ca2-3b1b-4347-a4d6-80159f70c2a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:34.260798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-26da1ca2-3b1b-4347-a4d6-80159f70c2a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:34.269242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-26da1ca2-3b1b-4347-a4d6-80159f70c2a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.091744 Dec 15 16:37:34.269818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 735/1678] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:34 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:34.748169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e993a42d-8623-4799-975d-2a2c9642dd7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:34.749133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e993a42d-8623-4799-975d-2a2c9642dd7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:34.755621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e993a42d-8623-4799-975d-2a2c9642dd7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:34.756072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e993a42d-8623-4799-975d-2a2c9642dd7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:34.756896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e993a42d-8623-4799-975d-2a2c9642dd7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:34.757322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e993a42d-8623-4799-975d-2a2c9642dd7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:34.787402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e993a42d-8623-4799-975d-2a2c9642dd7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Dec 15 16:37:34.787950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 944/1679] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:35.293566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d663ebf0-e972-4ed8-b63a-3b83263dc675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:35.294289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d663ebf0-e972-4ed8-b63a-3b83263dc675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:35.300969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d663ebf0-e972-4ed8-b63a-3b83263dc675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:35.301415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d663ebf0-e972-4ed8-b63a-3b83263dc675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:35.302213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d663ebf0-e972-4ed8-b63a-3b83263dc675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:35.302640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d663ebf0-e972-4ed8-b63a-3b83263dc675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:35.378951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d663ebf0-e972-4ed8-b63a-3b83263dc675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:35.389762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d663ebf0-e972-4ed8-b63a-3b83263dc675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.102168 Dec 15 16:37:35.390343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 736/1680] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:35.800129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cd2c8968-8d6f-45ed-b283-49e9fc9f0783 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:35.801232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cd2c8968-8d6f-45ed-b283-49e9fc9f0783 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:35.808971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cd2c8968-8d6f-45ed-b283-49e9fc9f0783 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:35.809474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cd2c8968-8d6f-45ed-b283-49e9fc9f0783 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:35.810267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cd2c8968-8d6f-45ed-b283-49e9fc9f0783 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:35.810754 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cd2c8968-8d6f-45ed-b283-49e9fc9f0783 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:35.843004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cd2c8968-8d6f-45ed-b283-49e9fc9f0783 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Dec 15 16:37:35.843564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 945/1681] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:36.407289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5ba21eab-5ffc-4a63-9bd3-00243218cac7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:36.407874 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5ba21eab-5ffc-4a63-9bd3-00243218cac7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:36.414524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ba21eab-5ffc-4a63-9bd3-00243218cac7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:36.414969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ba21eab-5ffc-4a63-9bd3-00243218cac7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:36.415746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ba21eab-5ffc-4a63-9bd3-00243218cac7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:36.416199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ba21eab-5ffc-4a63-9bd3-00243218cac7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:36.482757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5ba21eab-5ffc-4a63-9bd3-00243218cac7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:36.491361 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5ba21eab-5ffc-4a63-9bd3-00243218cac7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088066 Dec 15 16:37:36.491971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 737/1682] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:36 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:36.854976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-24622a6c-a96f-40a9-b0b6-3e0ac1d37090 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:36.855945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-24622a6c-a96f-40a9-b0b6-3e0ac1d37090 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:36.862774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24622a6c-a96f-40a9-b0b6-3e0ac1d37090 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:36.863228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24622a6c-a96f-40a9-b0b6-3e0ac1d37090 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:36.864024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24622a6c-a96f-40a9-b0b6-3e0ac1d37090 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:36.864460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24622a6c-a96f-40a9-b0b6-3e0ac1d37090 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:36.895503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-24622a6c-a96f-40a9-b0b6-3e0ac1d37090 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Dec 15 16:37:36.896069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 946/1683] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:37.515101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-946615c5-1bc9-4b49-a910-1ffe8201f3b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:37.515696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-946615c5-1bc9-4b49-a910-1ffe8201f3b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:37.522548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-946615c5-1bc9-4b49-a910-1ffe8201f3b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:37.522992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-946615c5-1bc9-4b49-a910-1ffe8201f3b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:37.523776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-946615c5-1bc9-4b49-a910-1ffe8201f3b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:37.524208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-946615c5-1bc9-4b49-a910-1ffe8201f3b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:37.591871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-946615c5-1bc9-4b49-a910-1ffe8201f3b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:37.599898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-946615c5-1bc9-4b49-a910-1ffe8201f3b7 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.090195 Dec 15 16:37:37.600893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 738/1684] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:37 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:37.907218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a993af1d-b682-49c9-8cae-cdfb3bbbcb77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:37.908122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a993af1d-b682-49c9-8cae-cdfb3bbbcb77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:37.915164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a993af1d-b682-49c9-8cae-cdfb3bbbcb77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:37.915604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a993af1d-b682-49c9-8cae-cdfb3bbbcb77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:37.916387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a993af1d-b682-49c9-8cae-cdfb3bbbcb77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:37.916855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a993af1d-b682-49c9-8cae-cdfb3bbbcb77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:37.951178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a993af1d-b682-49c9-8cae-cdfb3bbbcb77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047680 Dec 15 16:37:37.951770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 947/1685] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:38.617897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-777764f0-2832-416c-be63-a5cb79f6e56e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:38.618535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-777764f0-2832-416c-be63-a5cb79f6e56e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:38.625859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-777764f0-2832-416c-be63-a5cb79f6e56e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:38.626300 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-777764f0-2832-416c-be63-a5cb79f6e56e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:38.627086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-777764f0-2832-416c-be63-a5cb79f6e56e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:38.627516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-777764f0-2832-416c-be63-a5cb79f6e56e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:38.698447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-777764f0-2832-416c-be63-a5cb79f6e56e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:38.706326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-777764f0-2832-416c-be63-a5cb79f6e56e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.092524 Dec 15 16:37:38.706898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 739/1686] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:38.866604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:37:38.866898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:37:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:37:38.965647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-59a8b947-8ca5-49aa-a7eb-415957bada62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:38.966942 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-59a8b947-8ca5-49aa-a7eb-415957bada62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:38.976875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59a8b947-8ca5-49aa-a7eb-415957bada62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:38.977356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59a8b947-8ca5-49aa-a7eb-415957bada62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:38.978448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59a8b947-8ca5-49aa-a7eb-415957bada62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:38.979044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59a8b947-8ca5-49aa-a7eb-415957bada62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:39.010391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-59a8b947-8ca5-49aa-a7eb-415957bada62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050378 Dec 15 16:37:39.010965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 948/1687] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:39.724370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-552a0da6-16a1-480d-afc0-711182d40029 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:39.725063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-552a0da6-16a1-480d-afc0-711182d40029 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:39.731832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-552a0da6-16a1-480d-afc0-711182d40029 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:39.732280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-552a0da6-16a1-480d-afc0-711182d40029 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:39.733328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-552a0da6-16a1-480d-afc0-711182d40029 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:39.733585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-552a0da6-16a1-480d-afc0-711182d40029 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:39.805871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-552a0da6-16a1-480d-afc0-711182d40029 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:39.817225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-552a0da6-16a1-480d-afc0-711182d40029 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.096197 Dec 15 16:37:39.818006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 740/1688] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:40.023191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-15944a5e-5f59-4c6a-8ca5-ea82100c1984 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:40.024030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-15944a5e-5f59-4c6a-8ca5-ea82100c1984 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:40.031103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15944a5e-5f59-4c6a-8ca5-ea82100c1984 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:40.031550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15944a5e-5f59-4c6a-8ca5-ea82100c1984 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:40.032362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15944a5e-5f59-4c6a-8ca5-ea82100c1984 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:40.032824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-15944a5e-5f59-4c6a-8ca5-ea82100c1984 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:40.064463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-15944a5e-5f59-4c6a-8ca5-ea82100c1984 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Dec 15 16:37:40.065069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 949/1689] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:40.837590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0d167c49-d4a6-4888-933e-6c6cbcde7e5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:40.838446 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0d167c49-d4a6-4888-933e-6c6cbcde7e5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:40.846572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d167c49-d4a6-4888-933e-6c6cbcde7e5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:40.847016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d167c49-d4a6-4888-933e-6c6cbcde7e5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:40.847847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d167c49-d4a6-4888-933e-6c6cbcde7e5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:40.848272 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d167c49-d4a6-4888-933e-6c6cbcde7e5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:40.920171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0d167c49-d4a6-4888-933e-6c6cbcde7e5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:40.931702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0d167c49-d4a6-4888-933e-6c6cbcde7e5e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.098424 Dec 15 16:37:40.932686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 741/1690] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:40 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:41.077570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f2d7dee0-ff64-4169-8cd4-7e54ef6a28b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:41.078511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f2d7dee0-ff64-4169-8cd4-7e54ef6a28b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:41.085382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2d7dee0-ff64-4169-8cd4-7e54ef6a28b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:41.085828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2d7dee0-ff64-4169-8cd4-7e54ef6a28b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:41.086611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2d7dee0-ff64-4169-8cd4-7e54ef6a28b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:41.087030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2d7dee0-ff64-4169-8cd4-7e54ef6a28b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:41.118628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f2d7dee0-ff64-4169-8cd4-7e54ef6a28b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045176 Dec 15 16:37:41.119418 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 950/1691] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:41.950334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-942a11fb-bd25-4444-af90-7aa8e22747e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:41.951554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-942a11fb-bd25-4444-af90-7aa8e22747e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:41.958537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-942a11fb-bd25-4444-af90-7aa8e22747e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:41.958975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-942a11fb-bd25-4444-af90-7aa8e22747e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:41.960027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-942a11fb-bd25-4444-af90-7aa8e22747e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:41.960513 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-942a11fb-bd25-4444-af90-7aa8e22747e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:42.031472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-942a11fb-bd25-4444-af90-7aa8e22747e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:42.039544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-942a11fb-bd25-4444-af90-7aa8e22747e6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.092974 Dec 15 16:37:42.040112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 742/1692] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:41 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:42.132622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bd74602c-87cd-44f0-bc6c-5f9b9beb547b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:42.133554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bd74602c-87cd-44f0-bc6c-5f9b9beb547b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:42.140227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd74602c-87cd-44f0-bc6c-5f9b9beb547b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:42.140697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd74602c-87cd-44f0-bc6c-5f9b9beb547b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:42.141474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd74602c-87cd-44f0-bc6c-5f9b9beb547b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:42.141905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd74602c-87cd-44f0-bc6c-5f9b9beb547b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:42.172680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bd74602c-87cd-44f0-bc6c-5f9b9beb547b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Dec 15 16:37:42.173233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 951/1693] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:43.056775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5766ddb3-5435-4df7-a236-8ef9d2bae710 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:43.057389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5766ddb3-5435-4df7-a236-8ef9d2bae710 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:43.064245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5766ddb3-5435-4df7-a236-8ef9d2bae710 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:43.064730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5766ddb3-5435-4df7-a236-8ef9d2bae710 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:43.065534 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5766ddb3-5435-4df7-a236-8ef9d2bae710 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:43.065961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5766ddb3-5435-4df7-a236-8ef9d2bae710 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:43.134055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5766ddb3-5435-4df7-a236-8ef9d2bae710 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:43.142150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5766ddb3-5435-4df7-a236-8ef9d2bae710 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089149 Dec 15 16:37:43.142722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 743/1694] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:43 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:43.187026 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1847fb1d-003c-4bac-ac0a-eedf36886b8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:43.187980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1847fb1d-003c-4bac-ac0a-eedf36886b8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:43.194898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1847fb1d-003c-4bac-ac0a-eedf36886b8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:43.195332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1847fb1d-003c-4bac-ac0a-eedf36886b8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:43.196106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1847fb1d-003c-4bac-ac0a-eedf36886b8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:43.196567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1847fb1d-003c-4bac-ac0a-eedf36886b8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:43.227281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1847fb1d-003c-4bac-ac0a-eedf36886b8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Dec 15 16:37:43.227835 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 952/1695] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:44.159559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a18f5b83-5191-4e96-bbac-bb3f2bddcf73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:44.160153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a18f5b83-5191-4e96-bbac-bb3f2bddcf73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:44.166949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a18f5b83-5191-4e96-bbac-bb3f2bddcf73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:44.167406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a18f5b83-5191-4e96-bbac-bb3f2bddcf73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:44.168201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a18f5b83-5191-4e96-bbac-bb3f2bddcf73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:44.168673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a18f5b83-5191-4e96-bbac-bb3f2bddcf73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:44.239273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ef490091-c6b3-4d76-a073-1644a4ffabde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:44.240193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ef490091-c6b3-4d76-a073-1644a4ffabde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:44.240345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a18f5b83-5191-4e96-bbac-bb3f2bddcf73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:44.246767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ef490091-c6b3-4d76-a073-1644a4ffabde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:44.247216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ef490091-c6b3-4d76-a073-1644a4ffabde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:44.247976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a18f5b83-5191-4e96-bbac-bb3f2bddcf73 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.092260 Dec 15 16:37:44.248140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ef490091-c6b3-4d76-a073-1644a4ffabde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:44.248454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ef490091-c6b3-4d76-a073-1644a4ffabde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:44.248657 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 744/1696] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:44 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:44.279853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ef490091-c6b3-4d76-a073-1644a4ffabde tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Dec 15 16:37:44.280508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 953/1697] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:37:45.265243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-170afa87-8744-4679-8ed2-390c3b3b7c82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:45.265866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-170afa87-8744-4679-8ed2-390c3b3b7c82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:45.272585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-170afa87-8744-4679-8ed2-390c3b3b7c82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:45.273017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-170afa87-8744-4679-8ed2-390c3b3b7c82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:45.273807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-170afa87-8744-4679-8ed2-390c3b3b7c82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:45.274236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-170afa87-8744-4679-8ed2-390c3b3b7c82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:45.291301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ca25ed63-50e8-41f8-99e6-b1e66dd153fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:45.292420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ca25ed63-50e8-41f8-99e6-b1e66dd153fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:45.302529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca25ed63-50e8-41f8-99e6-b1e66dd153fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:45.303381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca25ed63-50e8-41f8-99e6-b1e66dd153fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:45.303847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca25ed63-50e8-41f8-99e6-b1e66dd153fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:45.304478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ca25ed63-50e8-41f8-99e6-b1e66dd153fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:45.337184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ca25ed63-50e8-41f8-99e6-b1e66dd153fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049149 Dec 15 16:37:45.337331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 954/1698] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:45.340384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-170afa87-8744-4679-8ed2-390c3b3b7c82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:45.348579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-170afa87-8744-4679-8ed2-390c3b3b7c82 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.087090 Dec 15 16:37:45.349123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 745/1699] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:46.348663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8d11ff38-f304-4936-a9a2-26c273fce37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:46.349555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8d11ff38-f304-4936-a9a2-26c273fce37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:46.356459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d11ff38-f304-4936-a9a2-26c273fce37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:46.356936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d11ff38-f304-4936-a9a2-26c273fce37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:46.357713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d11ff38-f304-4936-a9a2-26c273fce37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:46.358141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8d11ff38-f304-4936-a9a2-26c273fce37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:46.370976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-70d2f834-fd6d-4d35-b323-133a5e43efac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:46.371599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-70d2f834-fd6d-4d35-b323-133a5e43efac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:46.378802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70d2f834-fd6d-4d35-b323-133a5e43efac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:46.379262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70d2f834-fd6d-4d35-b323-133a5e43efac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:46.380066 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70d2f834-fd6d-4d35-b323-133a5e43efac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:46.380546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70d2f834-fd6d-4d35-b323-133a5e43efac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:46.388732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8d11ff38-f304-4936-a9a2-26c273fce37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Dec 15 16:37:46.389282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 955/1700] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:46.444804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-70d2f834-fd6d-4d35-b323-133a5e43efac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:46.452846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-70d2f834-fd6d-4d35-b323-133a5e43efac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.085567 Dec 15 16:37:46.453615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 746/1701] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:46 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:47.403360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3ec3f759-8fc3-449a-b507-cdbec2de72f1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:47.404583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3ec3f759-8fc3-449a-b507-cdbec2de72f1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:47.412242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ec3f759-8fc3-449a-b507-cdbec2de72f1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:47.412757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ec3f759-8fc3-449a-b507-cdbec2de72f1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:47.413542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ec3f759-8fc3-449a-b507-cdbec2de72f1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:47.413972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ec3f759-8fc3-449a-b507-cdbec2de72f1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:47.444181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3ec3f759-8fc3-449a-b507-cdbec2de72f1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Dec 15 16:37:47.444775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 956/1702] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:47 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:47.471994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1e11d96c-0d77-4a5e-bd72-a5e6e93abcbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:47.472644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1e11d96c-0d77-4a5e-bd72-a5e6e93abcbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:47.479791 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e11d96c-0d77-4a5e-bd72-a5e6e93abcbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:47.480245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e11d96c-0d77-4a5e-bd72-a5e6e93abcbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:47.481083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e11d96c-0d77-4a5e-bd72-a5e6e93abcbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:47.481521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e11d96c-0d77-4a5e-bd72-a5e6e93abcbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:47.548581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1e11d96c-0d77-4a5e-bd72-a5e6e93abcbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:47.556327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1e11d96c-0d77-4a5e-bd72-a5e6e93abcbf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088585 Dec 15 16:37:47.557090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 747/1703] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:48.458179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-33d35251-1eed-4fe8-853b-e8aa14ae514e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:48.459001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-33d35251-1eed-4fe8-853b-e8aa14ae514e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:48.466666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33d35251-1eed-4fe8-853b-e8aa14ae514e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:48.467115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33d35251-1eed-4fe8-853b-e8aa14ae514e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:48.467886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33d35251-1eed-4fe8-853b-e8aa14ae514e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:48.468315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-33d35251-1eed-4fe8-853b-e8aa14ae514e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:48.498002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-33d35251-1eed-4fe8-853b-e8aa14ae514e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Dec 15 16:37:48.498534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 957/1704] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:48.574606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ab6464c8-53a1-4385-8c3a-d5173d3696e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:48.575236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ab6464c8-53a1-4385-8c3a-d5173d3696e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:48.582063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab6464c8-53a1-4385-8c3a-d5173d3696e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:48.582505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab6464c8-53a1-4385-8c3a-d5173d3696e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:48.583282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab6464c8-53a1-4385-8c3a-d5173d3696e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:48.583711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab6464c8-53a1-4385-8c3a-d5173d3696e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:48.647532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ab6464c8-53a1-4385-8c3a-d5173d3696e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:48.658873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ab6464c8-53a1-4385-8c3a-d5173d3696e0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088347 Dec 15 16:37:48.659632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 748/1705] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:49.511487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fc348a09-e399-480e-b0d5-d77813d85651 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:49.512318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fc348a09-e399-480e-b0d5-d77813d85651 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:49.519260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc348a09-e399-480e-b0d5-d77813d85651 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:49.519707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc348a09-e399-480e-b0d5-d77813d85651 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:49.520488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc348a09-e399-480e-b0d5-d77813d85651 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:49.520940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc348a09-e399-480e-b0d5-d77813d85651 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:49.550438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fc348a09-e399-480e-b0d5-d77813d85651 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042802 Dec 15 16:37:49.550979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 958/1706] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:49.683650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-baf564b7-b974-4112-a2f3-de4d81bf6e6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:49.684730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-baf564b7-b974-4112-a2f3-de4d81bf6e6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:49.696493 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-baf564b7-b974-4112-a2f3-de4d81bf6e6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:49.697273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-baf564b7-b974-4112-a2f3-de4d81bf6e6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:49.698563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-baf564b7-b974-4112-a2f3-de4d81bf6e6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:49.699309 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-baf564b7-b974-4112-a2f3-de4d81bf6e6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:49.764486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-baf564b7-b974-4112-a2f3-de4d81bf6e6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:49.772753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-baf564b7-b974-4112-a2f3-de4d81bf6e6e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.094242 Dec 15 16:37:49.773324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 749/1707] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:49 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:50.562256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8bbe9b88-3a2a-4c2c-8708-0039c460b49a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:50.563156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8bbe9b88-3a2a-4c2c-8708-0039c460b49a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:50.569779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bbe9b88-3a2a-4c2c-8708-0039c460b49a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:50.570226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bbe9b88-3a2a-4c2c-8708-0039c460b49a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:50.571013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bbe9b88-3a2a-4c2c-8708-0039c460b49a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:50.571443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bbe9b88-3a2a-4c2c-8708-0039c460b49a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:50.602882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8bbe9b88-3a2a-4c2c-8708-0039c460b49a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044572 Dec 15 16:37:50.603470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 959/1708] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:50.790595 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-49dabaeb-6862-499f-9840-24b1d624df63 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:50.791210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-49dabaeb-6862-499f-9840-24b1d624df63 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:50.798170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49dabaeb-6862-499f-9840-24b1d624df63 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:50.798614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49dabaeb-6862-499f-9840-24b1d624df63 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:50.800048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49dabaeb-6862-499f-9840-24b1d624df63 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:50.800542 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49dabaeb-6862-499f-9840-24b1d624df63 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:50.869744 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-49dabaeb-6862-499f-9840-24b1d624df63 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:50.877916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-49dabaeb-6862-499f-9840-24b1d624df63 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.091202 Dec 15 16:37:50.878488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 750/1709] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:50 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:51.615433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-771ac877-f6ae-4090-ba3f-ed6b0cf2be6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:51.616347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-771ac877-f6ae-4090-ba3f-ed6b0cf2be6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:51.623077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-771ac877-f6ae-4090-ba3f-ed6b0cf2be6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:51.623522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-771ac877-f6ae-4090-ba3f-ed6b0cf2be6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:51.624297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-771ac877-f6ae-4090-ba3f-ed6b0cf2be6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:51.624759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-771ac877-f6ae-4090-ba3f-ed6b0cf2be6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:51.655323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-771ac877-f6ae-4090-ba3f-ed6b0cf2be6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Dec 15 16:37:51.655872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 960/1710] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:51.896820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4fc6a846-221f-48d0-9a71-d046f2cfb8f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:51.897350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4fc6a846-221f-48d0-9a71-d046f2cfb8f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:51.904240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4fc6a846-221f-48d0-9a71-d046f2cfb8f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:51.904709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4fc6a846-221f-48d0-9a71-d046f2cfb8f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:51.905485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4fc6a846-221f-48d0-9a71-d046f2cfb8f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:51.905914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4fc6a846-221f-48d0-9a71-d046f2cfb8f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:51.972402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4fc6a846-221f-48d0-9a71-d046f2cfb8f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:51.980556 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4fc6a846-221f-48d0-9a71-d046f2cfb8f8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088001 Dec 15 16:37:51.981175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 751/1711] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:52.668449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-155469fb-4b10-467e-806d-9f0f8316b0bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:52.669374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-155469fb-4b10-467e-806d-9f0f8316b0bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:52.676760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-155469fb-4b10-467e-806d-9f0f8316b0bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:52.677206 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-155469fb-4b10-467e-806d-9f0f8316b0bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:52.677996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-155469fb-4b10-467e-806d-9f0f8316b0bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:52.678418 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-155469fb-4b10-467e-806d-9f0f8316b0bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:52.710112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-155469fb-4b10-467e-806d-9f0f8316b0bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045567 Dec 15 16:37:52.710704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 961/1712] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:53.000947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1e3b3ab6-e793-46e1-85d9-cd9cc6c6cfce tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:53.001574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1e3b3ab6-e793-46e1-85d9-cd9cc6c6cfce tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:53.008791 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e3b3ab6-e793-46e1-85d9-cd9cc6c6cfce tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:53.009242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e3b3ab6-e793-46e1-85d9-cd9cc6c6cfce tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:53.010052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e3b3ab6-e793-46e1-85d9-cd9cc6c6cfce tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:53.010482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e3b3ab6-e793-46e1-85d9-cd9cc6c6cfce tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:53.080803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1e3b3ab6-e793-46e1-85d9-cd9cc6c6cfce tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:53.088491 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1e3b3ab6-e793-46e1-85d9-cd9cc6c6cfce tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.093311 Dec 15 16:37:53.089072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 752/1713] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:53.724467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d1a6c88b-90ae-46fc-8984-78398de218f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:53.725407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d1a6c88b-90ae-46fc-8984-78398de218f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:53.732338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1a6c88b-90ae-46fc-8984-78398de218f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:53.732818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1a6c88b-90ae-46fc-8984-78398de218f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:53.733603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1a6c88b-90ae-46fc-8984-78398de218f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:53.734032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d1a6c88b-90ae-46fc-8984-78398de218f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:53.767602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d1a6c88b-90ae-46fc-8984-78398de218f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048437 Dec 15 16:37:53.768813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 962/1714] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:53 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:54.106411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-db90f9c2-fc59-4f43-8f79-a43140d0ac89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:54.107023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-db90f9c2-fc59-4f43-8f79-a43140d0ac89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:54.113852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db90f9c2-fc59-4f43-8f79-a43140d0ac89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:54.114295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db90f9c2-fc59-4f43-8f79-a43140d0ac89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:54.115071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db90f9c2-fc59-4f43-8f79-a43140d0ac89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:54.115497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db90f9c2-fc59-4f43-8f79-a43140d0ac89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:54.179782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-db90f9c2-fc59-4f43-8f79-a43140d0ac89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:54.187715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-db90f9c2-fc59-4f43-8f79-a43140d0ac89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.085037 Dec 15 16:37:54.188293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 753/1715] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:54 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:54.782337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8a47b7a4-a51d-4fc7-a948-c0aebb026441 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:54.783436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8a47b7a4-a51d-4fc7-a948-c0aebb026441 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:54.791937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a47b7a4-a51d-4fc7-a948-c0aebb026441 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:54.792538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a47b7a4-a51d-4fc7-a948-c0aebb026441 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:54.793596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a47b7a4-a51d-4fc7-a948-c0aebb026441 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:54.794083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8a47b7a4-a51d-4fc7-a948-c0aebb026441 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:54.826244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8a47b7a4-a51d-4fc7-a948-c0aebb026441 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049436 Dec 15 16:37:54.826800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 963/1716] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:54 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:55.205244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b89a96af-505b-4546-bbb7-ab6a948a9ff4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:55.206213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b89a96af-505b-4546-bbb7-ab6a948a9ff4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:55.213194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b89a96af-505b-4546-bbb7-ab6a948a9ff4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:55.213640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b89a96af-505b-4546-bbb7-ab6a948a9ff4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:55.214427 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b89a96af-505b-4546-bbb7-ab6a948a9ff4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:55.214868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b89a96af-505b-4546-bbb7-ab6a948a9ff4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:55.287817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b89a96af-505b-4546-bbb7-ab6a948a9ff4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:55.300018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b89a96af-505b-4546-bbb7-ab6a948a9ff4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.098378 Dec 15 16:37:55.300862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 754/1717] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:55 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:55.838301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e64c5d14-0956-46a3-b19a-2f648393dfc1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:55.839214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e64c5d14-0956-46a3-b19a-2f648393dfc1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:55.846584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e64c5d14-0956-46a3-b19a-2f648393dfc1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:55.847036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e64c5d14-0956-46a3-b19a-2f648393dfc1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:55.847821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e64c5d14-0956-46a3-b19a-2f648393dfc1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:55.848252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e64c5d14-0956-46a3-b19a-2f648393dfc1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:55.879002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e64c5d14-0956-46a3-b19a-2f648393dfc1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Dec 15 16:37:55.879569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 964/1718] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:56.324197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fcea525a-564b-4c4e-b67a-18758758cd6b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:56.325002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fcea525a-564b-4c4e-b67a-18758758cd6b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:56.333584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fcea525a-564b-4c4e-b67a-18758758cd6b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:56.334037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fcea525a-564b-4c4e-b67a-18758758cd6b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:56.334856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fcea525a-564b-4c4e-b67a-18758758cd6b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:56.335294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fcea525a-564b-4c4e-b67a-18758758cd6b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:56.396792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fcea525a-564b-4c4e-b67a-18758758cd6b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:56.404445 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fcea525a-564b-4c4e-b67a-18758758cd6b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.086352 Dec 15 16:37:56.405035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 755/1719] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:56.892475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e201bdb-3f53-438f-a76f-bb36d4461be1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:56.893510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1e201bdb-3f53-438f-a76f-bb36d4461be1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:56.904110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e201bdb-3f53-438f-a76f-bb36d4461be1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:56.904638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e201bdb-3f53-438f-a76f-bb36d4461be1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:56.905832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e201bdb-3f53-438f-a76f-bb36d4461be1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:56.906570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e201bdb-3f53-438f-a76f-bb36d4461be1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:56.941734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1e201bdb-3f53-438f-a76f-bb36d4461be1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054019 Dec 15 16:37:56.942292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 965/1720] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:57.424988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3355adc5-d429-45fd-ab12-10c87ccf7c97 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:57.425730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3355adc5-d429-45fd-ab12-10c87ccf7c97 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:57.435656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3355adc5-d429-45fd-ab12-10c87ccf7c97 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:57.436328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3355adc5-d429-45fd-ab12-10c87ccf7c97 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:57.437552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3355adc5-d429-45fd-ab12-10c87ccf7c97 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:57.438297 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3355adc5-d429-45fd-ab12-10c87ccf7c97 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:57.501455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3355adc5-d429-45fd-ab12-10c87ccf7c97 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:57.509366 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3355adc5-d429-45fd-ab12-10c87ccf7c97 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.090387 Dec 15 16:37:57.509930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 756/1721] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:57.953745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-18b2e12e-8991-45f6-b797-6daf9c5924f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:57.954660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-18b2e12e-8991-45f6-b797-6daf9c5924f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:57.961607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18b2e12e-8991-45f6-b797-6daf9c5924f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:57.962056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18b2e12e-8991-45f6-b797-6daf9c5924f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:57.962842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18b2e12e-8991-45f6-b797-6daf9c5924f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:57.963280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18b2e12e-8991-45f6-b797-6daf9c5924f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:57.994332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-18b2e12e-8991-45f6-b797-6daf9c5924f9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Dec 15 16:37:57.994908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 966/1722] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:58.528624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-31780226-06b1-4018-a291-7cb8afd9626e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:58.529180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-31780226-06b1-4018-a291-7cb8afd9626e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:58.536109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31780226-06b1-4018-a291-7cb8afd9626e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:58.536600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31780226-06b1-4018-a291-7cb8afd9626e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:58.537362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31780226-06b1-4018-a291-7cb8afd9626e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:58.537789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31780226-06b1-4018-a291-7cb8afd9626e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:58.604389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-31780226-06b1-4018-a291-7cb8afd9626e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:58.612270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-31780226-06b1-4018-a291-7cb8afd9626e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.087471 Dec 15 16:37:58.612870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 757/1723] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:37:59.008522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-761a86ce-c063-4fc0-bb37-9f6dbdc15c71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:59.009452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-761a86ce-c063-4fc0-bb37-9f6dbdc15c71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:59.016469 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-761a86ce-c063-4fc0-bb37-9f6dbdc15c71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:59.016932 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-761a86ce-c063-4fc0-bb37-9f6dbdc15c71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:59.017764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-761a86ce-c063-4fc0-bb37-9f6dbdc15c71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:59.018204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-761a86ce-c063-4fc0-bb37-9f6dbdc15c71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:59.049948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-761a86ce-c063-4fc0-bb37-9f6dbdc15c71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045985 Dec 15 16:37:59.050507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 967/1724] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:37:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:37:59.196273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:37:59.196530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:37:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:37:59.632966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e882e9fb-c392-4111-80de-10cfd9192f49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:37:59.633726 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e882e9fb-c392-4111-80de-10cfd9192f49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:37:59.640124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e882e9fb-c392-4111-80de-10cfd9192f49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:59.640618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e882e9fb-c392-4111-80de-10cfd9192f49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:59.641390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e882e9fb-c392-4111-80de-10cfd9192f49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:37:59.641825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e882e9fb-c392-4111-80de-10cfd9192f49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:37:59.701895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e882e9fb-c392-4111-80de-10cfd9192f49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:37:59.709821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e882e9fb-c392-4111-80de-10cfd9192f49 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.082319 Dec 15 16:37:59.710384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 758/1725] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:37:59 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:00.061967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-667be4d5-478d-4f5a-9fb3-391ef26752bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:00.062900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-667be4d5-478d-4f5a-9fb3-391ef26752bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:00.069884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-667be4d5-478d-4f5a-9fb3-391ef26752bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:00.070331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-667be4d5-478d-4f5a-9fb3-391ef26752bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:00.071133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-667be4d5-478d-4f5a-9fb3-391ef26752bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:00.071567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-667be4d5-478d-4f5a-9fb3-391ef26752bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:00.102148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-667be4d5-478d-4f5a-9fb3-391ef26752bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Dec 15 16:38:00.102716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 968/1726] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:00.733311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5e491e53-93e0-4b64-8495-336bc4cf0f2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:00.733946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5e491e53-93e0-4b64-8495-336bc4cf0f2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:00.742542 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e491e53-93e0-4b64-8495-336bc4cf0f2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:00.742984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e491e53-93e0-4b64-8495-336bc4cf0f2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:00.743773 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e491e53-93e0-4b64-8495-336bc4cf0f2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:00.744203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e491e53-93e0-4b64-8495-336bc4cf0f2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:00.806508 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5e491e53-93e0-4b64-8495-336bc4cf0f2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:00.819007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5e491e53-93e0-4b64-8495-336bc4cf0f2d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089153 Dec 15 16:38:00.820158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 759/1727] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:01.117872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7128b8e0-59a4-4428-bb1b-3db5c6aea03a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:01.118786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7128b8e0-59a4-4428-bb1b-3db5c6aea03a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:01.126928 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7128b8e0-59a4-4428-bb1b-3db5c6aea03a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:01.127603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7128b8e0-59a4-4428-bb1b-3db5c6aea03a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:01.128869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7128b8e0-59a4-4428-bb1b-3db5c6aea03a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:01.129498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7128b8e0-59a4-4428-bb1b-3db5c6aea03a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:01.160724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7128b8e0-59a4-4428-bb1b-3db5c6aea03a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048628 Dec 15 16:38:01.161302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 969/1728] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:01.846947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c8d3ee83-453e-4dc3-ae7a-03671598f25e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:01.847723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c8d3ee83-453e-4dc3-ae7a-03671598f25e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:01.857465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8d3ee83-453e-4dc3-ae7a-03671598f25e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:01.857921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8d3ee83-453e-4dc3-ae7a-03671598f25e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:01.858711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8d3ee83-453e-4dc3-ae7a-03671598f25e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:01.859142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8d3ee83-453e-4dc3-ae7a-03671598f25e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:01.931378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c8d3ee83-453e-4dc3-ae7a-03671598f25e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:01.938842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c8d3ee83-453e-4dc3-ae7a-03671598f25e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.098453 Dec 15 16:38:01.939383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 760/1729] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:02.173467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e5868e5b-1027-4ad1-b11f-3b4f3337817f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:02.174375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5868e5b-1027-4ad1-b11f-3b4f3337817f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:02.181370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5868e5b-1027-4ad1-b11f-3b4f3337817f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:02.181810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5868e5b-1027-4ad1-b11f-3b4f3337817f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:02.182625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5868e5b-1027-4ad1-b11f-3b4f3337817f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:02.183016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5868e5b-1027-4ad1-b11f-3b4f3337817f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:02.212689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e5868e5b-1027-4ad1-b11f-3b4f3337817f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042988 Dec 15 16:38:02.213226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 970/1730] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:02.956719 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-858949bb-249d-4a59-bc49-b497a7eab6f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:02.957390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-858949bb-249d-4a59-bc49-b497a7eab6f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:02.964170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-858949bb-249d-4a59-bc49-b497a7eab6f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:02.964658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-858949bb-249d-4a59-bc49-b497a7eab6f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:02.965444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-858949bb-249d-4a59-bc49-b497a7eab6f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:02.966283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-858949bb-249d-4a59-bc49-b497a7eab6f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:03.032775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-858949bb-249d-4a59-bc49-b497a7eab6f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:03.040476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-858949bb-249d-4a59-bc49-b497a7eab6f4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.087604 Dec 15 16:38:03.041052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 761/1731] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:03.230064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3a42f2b3-d7ab-4ce5-8316-be5ab4d7f3ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:03.231225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3a42f2b3-d7ab-4ce5-8316-be5ab4d7f3ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:03.240675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a42f2b3-d7ab-4ce5-8316-be5ab4d7f3ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:03.241273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a42f2b3-d7ab-4ce5-8316-be5ab4d7f3ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:03.242010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a42f2b3-d7ab-4ce5-8316-be5ab4d7f3ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:03.242448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a42f2b3-d7ab-4ce5-8316-be5ab4d7f3ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:03.273924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3a42f2b3-d7ab-4ce5-8316-be5ab4d7f3ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049855 Dec 15 16:38:03.274477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 971/1732] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:04.057816 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d34d23ed-30a4-4737-b982-bd567c75f778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:04.058466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d34d23ed-30a4-4737-b982-bd567c75f778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:04.065272 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d34d23ed-30a4-4737-b982-bd567c75f778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:04.065727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d34d23ed-30a4-4737-b982-bd567c75f778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:04.066515 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d34d23ed-30a4-4737-b982-bd567c75f778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:04.066951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d34d23ed-30a4-4737-b982-bd567c75f778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:04.128873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d34d23ed-30a4-4737-b982-bd567c75f778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:04.138104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d34d23ed-30a4-4737-b982-bd567c75f778 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.084159 Dec 15 16:38:04.138671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 762/1733] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:04.288556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a0ebffeb-924a-43c9-acd8-e2e7bc6a09e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:04.289496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a0ebffeb-924a-43c9-acd8-e2e7bc6a09e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:04.296374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0ebffeb-924a-43c9-acd8-e2e7bc6a09e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:04.297807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0ebffeb-924a-43c9-acd8-e2e7bc6a09e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:04.298598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0ebffeb-924a-43c9-acd8-e2e7bc6a09e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:04.299030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a0ebffeb-924a-43c9-acd8-e2e7bc6a09e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:04.329919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a0ebffeb-924a-43c9-acd8-e2e7bc6a09e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047419 Dec 15 16:38:04.330446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 972/1734] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:04 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:05.155662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0b736783-5dfd-45b4-a8fc-6056693c8d5a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:05.156314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0b736783-5dfd-45b4-a8fc-6056693c8d5a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:05.163158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b736783-5dfd-45b4-a8fc-6056693c8d5a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:05.164115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b736783-5dfd-45b4-a8fc-6056693c8d5a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:05.164954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b736783-5dfd-45b4-a8fc-6056693c8d5a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:05.165382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b736783-5dfd-45b4-a8fc-6056693c8d5a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:05.228474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0b736783-5dfd-45b4-a8fc-6056693c8d5a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:05.237127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0b736783-5dfd-45b4-a8fc-6056693c8d5a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.085242 Dec 15 16:38:05.237748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 763/1735] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:05.343110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-02457f6d-f0c6-467d-9738-42a6f3d05814 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:05.344039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-02457f6d-f0c6-467d-9738-42a6f3d05814 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:05.351076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02457f6d-f0c6-467d-9738-42a6f3d05814 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:05.351415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02457f6d-f0c6-467d-9738-42a6f3d05814 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:05.352218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02457f6d-f0c6-467d-9738-42a6f3d05814 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:05.352684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02457f6d-f0c6-467d-9738-42a6f3d05814 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:05.382913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-02457f6d-f0c6-467d-9738-42a6f3d05814 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Dec 15 16:38:05.383416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 973/1736] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:06.257122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-04dfe166-3e6f-4a34-82ae-cff389fe0773 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:06.258034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-04dfe166-3e6f-4a34-82ae-cff389fe0773 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:06.266770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04dfe166-3e6f-4a34-82ae-cff389fe0773 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:06.267412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04dfe166-3e6f-4a34-82ae-cff389fe0773 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:06.268500 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04dfe166-3e6f-4a34-82ae-cff389fe0773 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:06.269163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04dfe166-3e6f-4a34-82ae-cff389fe0773 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:06.339163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-04dfe166-3e6f-4a34-82ae-cff389fe0773 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:06.350438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-04dfe166-3e6f-4a34-82ae-cff389fe0773 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.098456 Dec 15 16:38:06.351089 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 764/1737] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:06 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:06.394687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e3d39101-7975-4fca-9df9-472553db2363 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:06.395534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e3d39101-7975-4fca-9df9-472553db2363 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:06.402413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e3d39101-7975-4fca-9df9-472553db2363 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:06.402865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e3d39101-7975-4fca-9df9-472553db2363 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:06.403646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e3d39101-7975-4fca-9df9-472553db2363 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:06.404078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e3d39101-7975-4fca-9df9-472553db2363 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:06.435017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e3d39101-7975-4fca-9df9-472553db2363 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Dec 15 16:38:06.435593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 974/1738] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:07.503011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-961072aa-ad83-485c-90b7-64364d3e4084 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:07.503617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-961072aa-ad83-485c-90b7-64364d3e4084 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:07.510164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-961072aa-ad83-485c-90b7-64364d3e4084 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:07.510634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-961072aa-ad83-485c-90b7-64364d3e4084 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:07.511428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-961072aa-ad83-485c-90b7-64364d3e4084 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:07.511884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-961072aa-ad83-485c-90b7-64364d3e4084 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:07.572497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-961072aa-ad83-485c-90b7-64364d3e4084 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:07.577502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4da9a901-b357-404f-a32a-1730512ccd70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:07.578464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4da9a901-b357-404f-a32a-1730512ccd70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:07.579894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-961072aa-ad83-485c-90b7-64364d3e4084 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.210782 Dec 15 16:38:07.580488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 765/1739] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:07 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:07.584585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4da9a901-b357-404f-a32a-1730512ccd70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:07.585197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4da9a901-b357-404f-a32a-1730512ccd70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:07.585921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4da9a901-b357-404f-a32a-1730512ccd70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:07.586349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4da9a901-b357-404f-a32a-1730512ccd70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:07.615842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4da9a901-b357-404f-a32a-1730512ccd70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172861 Dec 15 16:38:07.616455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 975/1740] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:08.598444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-758c84b9-85f1-417c-ab76-ac95b8077f91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:08.599096 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-758c84b9-85f1-417c-ab76-ac95b8077f91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:08.606427 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-758c84b9-85f1-417c-ab76-ac95b8077f91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:08.606876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-758c84b9-85f1-417c-ab76-ac95b8077f91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:08.607671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-758c84b9-85f1-417c-ab76-ac95b8077f91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:08.608103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-758c84b9-85f1-417c-ab76-ac95b8077f91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:08.629581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-afb576e0-bee9-44ee-b473-29855e8ad6b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:08.630502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-afb576e0-bee9-44ee-b473-29855e8ad6b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:08.637370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afb576e0-bee9-44ee-b473-29855e8ad6b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:08.637821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afb576e0-bee9-44ee-b473-29855e8ad6b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:08.638615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afb576e0-bee9-44ee-b473-29855e8ad6b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:08.639056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afb576e0-bee9-44ee-b473-29855e8ad6b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:08.669677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-afb576e0-bee9-44ee-b473-29855e8ad6b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Dec 15 16:38:08.670291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 976/1741] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:08.671575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-758c84b9-85f1-417c-ab76-ac95b8077f91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:08.683438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-758c84b9-85f1-417c-ab76-ac95b8077f91 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088074 Dec 15 16:38:08.684738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 766/1742] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:09.683013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0067027d-d34d-4128-8ce1-bd804aa9b8f0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:09.683957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0067027d-d34d-4128-8ce1-bd804aa9b8f0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:09.690549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0067027d-d34d-4128-8ce1-bd804aa9b8f0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:09.690998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0067027d-d34d-4128-8ce1-bd804aa9b8f0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:09.691789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0067027d-d34d-4128-8ce1-bd804aa9b8f0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:09.692222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0067027d-d34d-4128-8ce1-bd804aa9b8f0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:09.708105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d37e3a8c-f156-4dee-9c3c-77d4db0aff0c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:09.708750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d37e3a8c-f156-4dee-9c3c-77d4db0aff0c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:09.716126 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d37e3a8c-f156-4dee-9c3c-77d4db0aff0c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:09.716612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d37e3a8c-f156-4dee-9c3c-77d4db0aff0c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:09.717409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d37e3a8c-f156-4dee-9c3c-77d4db0aff0c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:09.717825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d37e3a8c-f156-4dee-9c3c-77d4db0aff0c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:09.729183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0067027d-d34d-4128-8ce1-bd804aa9b8f0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049975 Dec 15 16:38:09.729781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 977/1743] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:09.786165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d37e3a8c-f156-4dee-9c3c-77d4db0aff0c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:09.794369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d37e3a8c-f156-4dee-9c3c-77d4db0aff0c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089925 Dec 15 16:38:09.795023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 767/1744] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:38:10.743395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ba9d8f0e-ff44-49f9-9a1e-3c391246ed58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:10.744292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ba9d8f0e-ff44-49f9-9a1e-3c391246ed58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:10.751089 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba9d8f0e-ff44-49f9-9a1e-3c391246ed58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:10.751533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba9d8f0e-ff44-49f9-9a1e-3c391246ed58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:10.752366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba9d8f0e-ff44-49f9-9a1e-3c391246ed58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:10.753160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba9d8f0e-ff44-49f9-9a1e-3c391246ed58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:10.786604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ba9d8f0e-ff44-49f9-9a1e-3c391246ed58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048695 Dec 15 16:38:10.787170 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 978/1745] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:10.814795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1d74b3eb-8142-4ccf-957d-28ff67e07fac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:10.815562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1d74b3eb-8142-4ccf-957d-28ff67e07fac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:10.822555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d74b3eb-8142-4ccf-957d-28ff67e07fac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:10.823009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d74b3eb-8142-4ccf-957d-28ff67e07fac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:10.823803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d74b3eb-8142-4ccf-957d-28ff67e07fac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:10.824241 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d74b3eb-8142-4ccf-957d-28ff67e07fac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:10.894492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1d74b3eb-8142-4ccf-957d-28ff67e07fac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:10.903517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1d74b3eb-8142-4ccf-957d-28ff67e07fac tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.092411 Dec 15 16:38:10.904072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 768/1746] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:38:11.799827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eae6ac45-8766-4495-bc3c-87bb9ad9db9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:11.801099 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eae6ac45-8766-4495-bc3c-87bb9ad9db9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:11.809150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eae6ac45-8766-4495-bc3c-87bb9ad9db9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:11.809593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eae6ac45-8766-4495-bc3c-87bb9ad9db9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:11.810375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eae6ac45-8766-4495-bc3c-87bb9ad9db9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:11.810802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eae6ac45-8766-4495-bc3c-87bb9ad9db9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:11.841327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eae6ac45-8766-4495-bc3c-87bb9ad9db9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Dec 15 16:38:11.841887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 979/1747] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:11.921454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6c9e815b-475a-4419-857e-29000736c31f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:11.922032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6c9e815b-475a-4419-857e-29000736c31f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:11.929598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6c9e815b-475a-4419-857e-29000736c31f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:11.930062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6c9e815b-475a-4419-857e-29000736c31f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:11.930925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6c9e815b-475a-4419-857e-29000736c31f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:11.931409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6c9e815b-475a-4419-857e-29000736c31f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:11.998962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6c9e815b-475a-4419-857e-29000736c31f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:12.007044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6c9e815b-475a-4419-857e-29000736c31f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089739 Dec 15 16:38:12.007605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 769/1748] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:11 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:12.855442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f655ff9a-312c-4671-b0bd-c8f4bcc4dc49 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:12.856366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f655ff9a-312c-4671-b0bd-c8f4bcc4dc49 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:12.863974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f655ff9a-312c-4671-b0bd-c8f4bcc4dc49 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:12.864489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f655ff9a-312c-4671-b0bd-c8f4bcc4dc49 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:12.865654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f655ff9a-312c-4671-b0bd-c8f4bcc4dc49 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:12.866238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f655ff9a-312c-4671-b0bd-c8f4bcc4dc49 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:12.901829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f655ff9a-312c-4671-b0bd-c8f4bcc4dc49 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051104 Dec 15 16:38:12.902405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 980/1749] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:13.025488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-44d4121d-a22f-45e7-bc55-4544d6994187 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:13.026094 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-44d4121d-a22f-45e7-bc55-4544d6994187 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:13.033139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44d4121d-a22f-45e7-bc55-4544d6994187 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:13.033587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44d4121d-a22f-45e7-bc55-4544d6994187 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:13.034417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44d4121d-a22f-45e7-bc55-4544d6994187 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:13.034870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44d4121d-a22f-45e7-bc55-4544d6994187 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:13.103837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-44d4121d-a22f-45e7-bc55-4544d6994187 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:13.111767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-44d4121d-a22f-45e7-bc55-4544d6994187 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.090095 Dec 15 16:38:13.112275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 770/1750] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:13.918213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cea6f9c5-9b19-4176-9bd5-ac497800c72b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:13.919487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cea6f9c5-9b19-4176-9bd5-ac497800c72b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:13.929398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cea6f9c5-9b19-4176-9bd5-ac497800c72b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:13.930095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cea6f9c5-9b19-4176-9bd5-ac497800c72b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:13.931258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cea6f9c5-9b19-4176-9bd5-ac497800c72b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:13.931691 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cea6f9c5-9b19-4176-9bd5-ac497800c72b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:13.962843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cea6f9c5-9b19-4176-9bd5-ac497800c72b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051054 Dec 15 16:38:13.963418 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 981/1751] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:13 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:14.128895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3b98d0ce-5d28-4c24-a530-c27b6de63c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:14.129440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3b98d0ce-5d28-4c24-a530-c27b6de63c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:14.137236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3b98d0ce-5d28-4c24-a530-c27b6de63c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:14.137682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3b98d0ce-5d28-4c24-a530-c27b6de63c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:14.138471 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3b98d0ce-5d28-4c24-a530-c27b6de63c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:14.138905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3b98d0ce-5d28-4c24-a530-c27b6de63c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:14.199614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3b98d0ce-5d28-4c24-a530-c27b6de63c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:14.207376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3b98d0ce-5d28-4c24-a530-c27b6de63c23 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.082680 Dec 15 16:38:14.207940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 771/1752] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:14.979193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-267adc90-7427-4b10-9758-63362fbcb3d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:14.980104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-267adc90-7427-4b10-9758-63362fbcb3d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:14.986842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-267adc90-7427-4b10-9758-63362fbcb3d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:14.987292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-267adc90-7427-4b10-9758-63362fbcb3d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:14.988084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-267adc90-7427-4b10-9758-63362fbcb3d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:14.988527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-267adc90-7427-4b10-9758-63362fbcb3d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:15.026845 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-267adc90-7427-4b10-9758-63362fbcb3d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053275 Dec 15 16:38:15.027587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 982/1753] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:14 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:15.225427 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-43898676-9641-4804-98b6-2a9b56fa4206 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:15.226040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-43898676-9641-4804-98b6-2a9b56fa4206 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:15.232596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-43898676-9641-4804-98b6-2a9b56fa4206 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:15.232805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-43898676-9641-4804-98b6-2a9b56fa4206 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:15.233827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-43898676-9641-4804-98b6-2a9b56fa4206 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:15.234331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-43898676-9641-4804-98b6-2a9b56fa4206 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:15.306281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-43898676-9641-4804-98b6-2a9b56fa4206 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:15.314978 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-43898676-9641-4804-98b6-2a9b56fa4206 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.093264 Dec 15 16:38:15.315553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 772/1754] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:16.042897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8b6fdc82-9185-459a-b662-d2c4acdf7388 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:16.044095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8b6fdc82-9185-459a-b662-d2c4acdf7388 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:16.053550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b6fdc82-9185-459a-b662-d2c4acdf7388 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:16.054145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b6fdc82-9185-459a-b662-d2c4acdf7388 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:16.055172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b6fdc82-9185-459a-b662-d2c4acdf7388 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:16.055750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b6fdc82-9185-459a-b662-d2c4acdf7388 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:16.086894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8b6fdc82-9185-459a-b662-d2c4acdf7388 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049566 Dec 15 16:38:16.087491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 983/1755] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:16 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:16.333709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bf3931e0-6bf4-44b2-8246-9dbf137d4a3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:16.334334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bf3931e0-6bf4-44b2-8246-9dbf137d4a3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:16.342582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bf3931e0-6bf4-44b2-8246-9dbf137d4a3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:16.343033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bf3931e0-6bf4-44b2-8246-9dbf137d4a3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:16.343824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bf3931e0-6bf4-44b2-8246-9dbf137d4a3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:16.344250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bf3931e0-6bf4-44b2-8246-9dbf137d4a3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:16.405533 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bf3931e0-6bf4-44b2-8246-9dbf137d4a3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:16.416387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bf3931e0-6bf4-44b2-8246-9dbf137d4a3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.087748 Dec 15 16:38:16.416997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 773/1756] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:16 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:17.102891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0add6a9c-9301-469b-a3c0-4b85278f862d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:17.104035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0add6a9c-9301-469b-a3c0-4b85278f862d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:17.110555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0add6a9c-9301-469b-a3c0-4b85278f862d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:17.111006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0add6a9c-9301-469b-a3c0-4b85278f862d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:17.111792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0add6a9c-9301-469b-a3c0-4b85278f862d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:17.112224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0add6a9c-9301-469b-a3c0-4b85278f862d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:17.142082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0add6a9c-9301-469b-a3c0-4b85278f862d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045348 Dec 15 16:38:17.142646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 984/1757] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:17.435424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e1a162df-ae4b-4da1-b47a-75a7982e0f1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:17.436163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e1a162df-ae4b-4da1-b47a-75a7982e0f1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:17.444477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1a162df-ae4b-4da1-b47a-75a7982e0f1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:17.445047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1a162df-ae4b-4da1-b47a-75a7982e0f1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:17.446017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1a162df-ae4b-4da1-b47a-75a7982e0f1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:17.446587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1a162df-ae4b-4da1-b47a-75a7982e0f1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:17.508109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1a162df-ae4b-4da1-b47a-75a7982e0f1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:17.520947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e1a162df-ae4b-4da1-b47a-75a7982e0f1d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089897 Dec 15 16:38:17.521833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 774/1758] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:17 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:18.153744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aa14a4cc-6778-4454-a4d0-91b0e5e7a239 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:18.154602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aa14a4cc-6778-4454-a4d0-91b0e5e7a239 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:18.161619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa14a4cc-6778-4454-a4d0-91b0e5e7a239 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:18.162064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa14a4cc-6778-4454-a4d0-91b0e5e7a239 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:18.162849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa14a4cc-6778-4454-a4d0-91b0e5e7a239 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:18.163288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aa14a4cc-6778-4454-a4d0-91b0e5e7a239 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:18.194227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aa14a4cc-6778-4454-a4d0-91b0e5e7a239 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Dec 15 16:38:18.195266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 985/1759] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:18.543484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-697235ae-f5c9-42d1-add3-39acd6578def tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:18.544051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-697235ae-f5c9-42d1-add3-39acd6578def tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:18.550941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-697235ae-f5c9-42d1-add3-39acd6578def tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:18.551383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-697235ae-f5c9-42d1-add3-39acd6578def tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:18.552159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-697235ae-f5c9-42d1-add3-39acd6578def tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:18.552628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-697235ae-f5c9-42d1-add3-39acd6578def tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:18.624507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-697235ae-f5c9-42d1-add3-39acd6578def tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:18.635652 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-697235ae-f5c9-42d1-add3-39acd6578def tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.095721 Dec 15 16:38:18.636584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 775/1760] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:19.206093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3f9b558d-e333-435d-b499-d7fa4309cfb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:19.206999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3f9b558d-e333-435d-b499-d7fa4309cfb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:19.214346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f9b558d-e333-435d-b499-d7fa4309cfb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:19.214996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f9b558d-e333-435d-b499-d7fa4309cfb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:19.216309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f9b558d-e333-435d-b499-d7fa4309cfb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:19.216775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f9b558d-e333-435d-b499-d7fa4309cfb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:19.246484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3f9b558d-e333-435d-b499-d7fa4309cfb4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044288 Dec 15 16:38:19.247082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 986/1761] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:19 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:19.661912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3725144f-631b-40f7-8df3-b146fb36e7f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:19.662748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3725144f-631b-40f7-8df3-b146fb36e7f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:19.670975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3725144f-631b-40f7-8df3-b146fb36e7f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:19.671396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3725144f-631b-40f7-8df3-b146fb36e7f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:19.672196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3725144f-631b-40f7-8df3-b146fb36e7f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:19.672672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3725144f-631b-40f7-8df3-b146fb36e7f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:19.735721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3725144f-631b-40f7-8df3-b146fb36e7f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:19.743378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3725144f-631b-40f7-8df3-b146fb36e7f6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.086916 Dec 15 16:38:19.743939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 776/1762] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:20.258870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1571e7b2-a5eb-4a8c-ad55-ff888d2581d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:20.259881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1571e7b2-a5eb-4a8c-ad55-ff888d2581d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:20.266837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1571e7b2-a5eb-4a8c-ad55-ff888d2581d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:20.267281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1571e7b2-a5eb-4a8c-ad55-ff888d2581d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:20.268059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1571e7b2-a5eb-4a8c-ad55-ff888d2581d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:20.268524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1571e7b2-a5eb-4a8c-ad55-ff888d2581d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:20.300611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1571e7b2-a5eb-4a8c-ad55-ff888d2581d8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Dec 15 16:38:20.301183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 987/1763] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:20 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:20.760413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-87f89d11-a5df-4530-ad37-09fecd24490b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:20.761153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-87f89d11-a5df-4530-ad37-09fecd24490b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:20.767726 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87f89d11-a5df-4530-ad37-09fecd24490b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:20.768151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87f89d11-a5df-4530-ad37-09fecd24490b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:20.768953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87f89d11-a5df-4530-ad37-09fecd24490b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:20.769380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87f89d11-a5df-4530-ad37-09fecd24490b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:20.838126 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-87f89d11-a5df-4530-ad37-09fecd24490b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:20.850029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-87f89d11-a5df-4530-ad37-09fecd24490b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.093045 Dec 15 16:38:20.850807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 777/1764] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:20 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:21.315680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7f531222-64ef-47d5-b977-38a3f51faaab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:21.316800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7f531222-64ef-47d5-b977-38a3f51faaab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:21.325332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f531222-64ef-47d5-b977-38a3f51faaab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:21.325752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f531222-64ef-47d5-b977-38a3f51faaab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:21.326564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f531222-64ef-47d5-b977-38a3f51faaab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:21.326995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f531222-64ef-47d5-b977-38a3f51faaab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:21.362111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7f531222-64ef-47d5-b977-38a3f51faaab tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050997 Dec 15 16:38:21.362697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 988/1765] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:21.868942 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d5dcb116-1c61-4707-ae04-0eb57666502d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:21.869615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d5dcb116-1c61-4707-ae04-0eb57666502d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:21.876466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5dcb116-1c61-4707-ae04-0eb57666502d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:21.876930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5dcb116-1c61-4707-ae04-0eb57666502d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:21.877729 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5dcb116-1c61-4707-ae04-0eb57666502d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:21.878156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d5dcb116-1c61-4707-ae04-0eb57666502d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:21.948157 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d5dcb116-1c61-4707-ae04-0eb57666502d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:21.956949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d5dcb116-1c61-4707-ae04-0eb57666502d tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.091657 Dec 15 16:38:21.957535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 778/1766] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:22.376086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f710e8f5-7fdd-41a2-b20a-af176bfa4c51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:22.376945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f710e8f5-7fdd-41a2-b20a-af176bfa4c51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:22.384855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f710e8f5-7fdd-41a2-b20a-af176bfa4c51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:22.385349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f710e8f5-7fdd-41a2-b20a-af176bfa4c51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:22.386561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f710e8f5-7fdd-41a2-b20a-af176bfa4c51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:22.387180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f710e8f5-7fdd-41a2-b20a-af176bfa4c51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:22.421654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f710e8f5-7fdd-41a2-b20a-af176bfa4c51 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049430 Dec 15 16:38:22.422243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 989/1767] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:22.979588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cf81475b-f730-484d-ba1d-8701a538572b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:22.980559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cf81475b-f730-484d-ba1d-8701a538572b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:22.988889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf81475b-f730-484d-ba1d-8701a538572b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:22.989506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf81475b-f730-484d-ba1d-8701a538572b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:22.990645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf81475b-f730-484d-ba1d-8701a538572b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:22.991293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf81475b-f730-484d-ba1d-8701a538572b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:23.052535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cf81475b-f730-484d-ba1d-8701a538572b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:23.060544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cf81475b-f730-484d-ba1d-8701a538572b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.086571 Dec 15 16:38:23.061121 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 779/1768] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:22 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:23.435049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-52c2df1e-1f9f-46cf-ae21-0646f73b976a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:23.435962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-52c2df1e-1f9f-46cf-ae21-0646f73b976a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:23.442760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52c2df1e-1f9f-46cf-ae21-0646f73b976a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:23.443211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52c2df1e-1f9f-46cf-ae21-0646f73b976a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:23.444005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52c2df1e-1f9f-46cf-ae21-0646f73b976a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:23.444464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52c2df1e-1f9f-46cf-ae21-0646f73b976a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:23.474687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-52c2df1e-1f9f-46cf-ae21-0646f73b976a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Dec 15 16:38:23.475255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 990/1769] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:23 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:24.086073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8b60e173-87f1-41ba-9cf5-cdda4e086aae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:24.087124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8b60e173-87f1-41ba-9cf5-cdda4e086aae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:24.095757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b60e173-87f1-41ba-9cf5-cdda4e086aae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:24.096207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b60e173-87f1-41ba-9cf5-cdda4e086aae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:24.097050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b60e173-87f1-41ba-9cf5-cdda4e086aae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:24.097484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b60e173-87f1-41ba-9cf5-cdda4e086aae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:24.162202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8b60e173-87f1-41ba-9cf5-cdda4e086aae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:24.172329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8b60e173-87f1-41ba-9cf5-cdda4e086aae tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.092345 Dec 15 16:38:24.172945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 780/1770] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:24.489113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b88d3be9-c6be-475e-afab-3e47f6fabbb2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:24.490164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b88d3be9-c6be-475e-afab-3e47f6fabbb2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:24.499016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b88d3be9-c6be-475e-afab-3e47f6fabbb2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:24.499621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b88d3be9-c6be-475e-afab-3e47f6fabbb2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:24.500655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b88d3be9-c6be-475e-afab-3e47f6fabbb2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:24.501274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b88d3be9-c6be-475e-afab-3e47f6fabbb2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:24.534209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b88d3be9-c6be-475e-afab-3e47f6fabbb2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051066 Dec 15 16:38:24.534761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 991/1771] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:24 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:25.189860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-79931abc-9576-403e-bb64-ea6ed5acd4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:25.190477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-79931abc-9576-403e-bb64-ea6ed5acd4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:25.197511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79931abc-9576-403e-bb64-ea6ed5acd4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:25.197956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79931abc-9576-403e-bb64-ea6ed5acd4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:25.198746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79931abc-9576-403e-bb64-ea6ed5acd4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:25.199329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79931abc-9576-403e-bb64-ea6ed5acd4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:25.269650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-79931abc-9576-403e-bb64-ea6ed5acd4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:25.277644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-79931abc-9576-403e-bb64-ea6ed5acd4fc tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.091443 Dec 15 16:38:25.278270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 781/1772] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:25.549563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0fd1acda-0afc-47b2-ad58-366dc34e1cad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:25.550473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0fd1acda-0afc-47b2-ad58-366dc34e1cad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:25.559537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0fd1acda-0afc-47b2-ad58-366dc34e1cad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:25.560009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0fd1acda-0afc-47b2-ad58-366dc34e1cad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:25.560827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0fd1acda-0afc-47b2-ad58-366dc34e1cad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:25.561247 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0fd1acda-0afc-47b2-ad58-366dc34e1cad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:25.591700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0fd1acda-0afc-47b2-ad58-366dc34e1cad tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048340 Dec 15 16:38:25.592252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 992/1773] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:25 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:26.295711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ae2d29c7-22d7-4cc8-a366-e5c9d731834e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:26.296265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ae2d29c7-22d7-4cc8-a366-e5c9d731834e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:26.303229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae2d29c7-22d7-4cc8-a366-e5c9d731834e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:26.303677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae2d29c7-22d7-4cc8-a366-e5c9d731834e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:26.304462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae2d29c7-22d7-4cc8-a366-e5c9d731834e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:26.304933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae2d29c7-22d7-4cc8-a366-e5c9d731834e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:26.367802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ae2d29c7-22d7-4cc8-a366-e5c9d731834e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:26.379888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ae2d29c7-22d7-4cc8-a366-e5c9d731834e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.087933 Dec 15 16:38:26.380786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 782/1774] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:26 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:26.606686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e4c9c92d-c7a1-425d-99a5-4604c5cf148e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:26.607602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e4c9c92d-c7a1-425d-99a5-4604c5cf148e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:26.614303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e4c9c92d-c7a1-425d-99a5-4604c5cf148e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:26.614755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e4c9c92d-c7a1-425d-99a5-4604c5cf148e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:26.615574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e4c9c92d-c7a1-425d-99a5-4604c5cf148e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:26.616010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e4c9c92d-c7a1-425d-99a5-4604c5cf148e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:26.647977 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e4c9c92d-c7a1-425d-99a5-4604c5cf148e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047374 Dec 15 16:38:26.648788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 993/1775] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:27.403000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d121aaa8-f58c-4caf-8677-bbb17357a5c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:27.404084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d121aaa8-f58c-4caf-8677-bbb17357a5c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:27.413019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d121aaa8-f58c-4caf-8677-bbb17357a5c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:27.413746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d121aaa8-f58c-4caf-8677-bbb17357a5c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:27.414537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d121aaa8-f58c-4caf-8677-bbb17357a5c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:27.414971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d121aaa8-f58c-4caf-8677-bbb17357a5c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:27.482495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d121aaa8-f58c-4caf-8677-bbb17357a5c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:27.490229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d121aaa8-f58c-4caf-8677-bbb17357a5c4 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.091443 Dec 15 16:38:27.490798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 783/1776] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:27.660096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-de72ae4f-a23f-48d4-80ce-062094f3b474 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:27.660959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-de72ae4f-a23f-48d4-80ce-062094f3b474 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:27.667616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de72ae4f-a23f-48d4-80ce-062094f3b474 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:27.668095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de72ae4f-a23f-48d4-80ce-062094f3b474 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:27.668923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de72ae4f-a23f-48d4-80ce-062094f3b474 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:27.669352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de72ae4f-a23f-48d4-80ce-062094f3b474 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:27.699816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-de72ae4f-a23f-48d4-80ce-062094f3b474 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043374 Dec 15 16:38:27.700423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 994/1777] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:27 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:28.507491 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-42148e59-ba60-48a9-a602-91f3bcc78cc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:28.508073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-42148e59-ba60-48a9-a602-91f3bcc78cc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:28.514807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42148e59-ba60-48a9-a602-91f3bcc78cc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:28.515251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42148e59-ba60-48a9-a602-91f3bcc78cc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:28.516181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42148e59-ba60-48a9-a602-91f3bcc78cc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:28.516479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42148e59-ba60-48a9-a602-91f3bcc78cc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:28.579099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-42148e59-ba60-48a9-a602-91f3bcc78cc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:28.587099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-42148e59-ba60-48a9-a602-91f3bcc78cc8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.083443 Dec 15 16:38:28.587667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 784/1778] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:28.711433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3a5add26-20a7-4982-bcdd-4514f4d7bad3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:28.712364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3a5add26-20a7-4982-bcdd-4514f4d7bad3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:28.719586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a5add26-20a7-4982-bcdd-4514f4d7bad3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:28.720034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a5add26-20a7-4982-bcdd-4514f4d7bad3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:28.720852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a5add26-20a7-4982-bcdd-4514f4d7bad3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:28.721280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3a5add26-20a7-4982-bcdd-4514f4d7bad3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:28.751685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3a5add26-20a7-4982-bcdd-4514f4d7bad3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Dec 15 16:38:28.752250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 995/1779] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:29.604723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0445a738-2ecc-4dbe-a863-9f35dd9f81a8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:29.605408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0445a738-2ecc-4dbe-a863-9f35dd9f81a8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:29.612133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0445a738-2ecc-4dbe-a863-9f35dd9f81a8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:29.612616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0445a738-2ecc-4dbe-a863-9f35dd9f81a8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:29.613405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0445a738-2ecc-4dbe-a863-9f35dd9f81a8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:29.613842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0445a738-2ecc-4dbe-a863-9f35dd9f81a8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:29.685681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0445a738-2ecc-4dbe-a863-9f35dd9f81a8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:29.693722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0445a738-2ecc-4dbe-a863-9f35dd9f81a8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.092818 Dec 15 16:38:29.694307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 785/1780] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:29.764230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-976eeb63-3b98-46d3-8301-a40aa0a6ce1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:29.765162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-976eeb63-3b98-46d3-8301-a40aa0a6ce1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:29.771768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-976eeb63-3b98-46d3-8301-a40aa0a6ce1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:29.772212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-976eeb63-3b98-46d3-8301-a40aa0a6ce1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:29.773057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-976eeb63-3b98-46d3-8301-a40aa0a6ce1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:29.773459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-976eeb63-3b98-46d3-8301-a40aa0a6ce1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:29.803140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-976eeb63-3b98-46d3-8301-a40aa0a6ce1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042817 Dec 15 16:38:29.803708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 996/1781] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:38:30.711428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-10024556-78fe-4f9d-96c1-642a502de83a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:30.712020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-10024556-78fe-4f9d-96c1-642a502de83a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:30.719418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10024556-78fe-4f9d-96c1-642a502de83a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:30.719860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10024556-78fe-4f9d-96c1-642a502de83a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:30.720697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10024556-78fe-4f9d-96c1-642a502de83a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:30.721120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10024556-78fe-4f9d-96c1-642a502de83a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:30.783610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-10024556-78fe-4f9d-96c1-642a502de83a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:30.791580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-10024556-78fe-4f9d-96c1-642a502de83a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.083815 Dec 15 16:38:30.792165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 786/1782] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:30 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:30.814364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-712df496-a840-46ae-b29d-2ad16228b161 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:30.815264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-712df496-a840-46ae-b29d-2ad16228b161 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:30.821885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-712df496-a840-46ae-b29d-2ad16228b161 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:30.822333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-712df496-a840-46ae-b29d-2ad16228b161 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:30.823106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-712df496-a840-46ae-b29d-2ad16228b161 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:30.823541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-712df496-a840-46ae-b29d-2ad16228b161 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:30.855890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-712df496-a840-46ae-b29d-2ad16228b161 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Dec 15 16:38:30.856632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 997/1783] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:31.808950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f1b5c7b9-c19a-441a-a50d-0398df14649f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:31.809671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f1b5c7b9-c19a-441a-a50d-0398df14649f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:31.816267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1b5c7b9-c19a-441a-a50d-0398df14649f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:31.816748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1b5c7b9-c19a-441a-a50d-0398df14649f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:31.817530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1b5c7b9-c19a-441a-a50d-0398df14649f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:31.817956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1b5c7b9-c19a-441a-a50d-0398df14649f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:31.869604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-45e94b19-1da0-4d77-aa14-c6a1bfd1a843 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:31.870495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-45e94b19-1da0-4d77-aa14-c6a1bfd1a843 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:31.877407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-45e94b19-1da0-4d77-aa14-c6a1bfd1a843 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:31.877607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-45e94b19-1da0-4d77-aa14-c6a1bfd1a843 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:31.878392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-45e94b19-1da0-4d77-aa14-c6a1bfd1a843 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:31.878813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-45e94b19-1da0-4d77-aa14-c6a1bfd1a843 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:31.879722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f1b5c7b9-c19a-441a-a50d-0398df14649f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:31.887944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f1b5c7b9-c19a-441a-a50d-0398df14649f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.082384 Dec 15 16:38:31.889013 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 787/1784] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:31 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:31.914072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-45e94b19-1da0-4d77-aa14-c6a1bfd1a843 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048166 Dec 15 16:38:31.914650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 998/1785] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:32.906706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-213ecb17-3be2-4cd5-b48b-69974f571281 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:32.907369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-213ecb17-3be2-4cd5-b48b-69974f571281 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:32.914528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-213ecb17-3be2-4cd5-b48b-69974f571281 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:32.914981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-213ecb17-3be2-4cd5-b48b-69974f571281 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:32.915786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-213ecb17-3be2-4cd5-b48b-69974f571281 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:32.916228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-213ecb17-3be2-4cd5-b48b-69974f571281 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:32.926654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9748ad9f-7b8f-4989-9a45-c9c7788e3a7a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:32.927553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9748ad9f-7b8f-4989-9a45-c9c7788e3a7a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:32.933960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9748ad9f-7b8f-4989-9a45-c9c7788e3a7a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:32.934483 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9748ad9f-7b8f-4989-9a45-c9c7788e3a7a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:32.935278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9748ad9f-7b8f-4989-9a45-c9c7788e3a7a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:32.935693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9748ad9f-7b8f-4989-9a45-c9c7788e3a7a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:32.967153 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9748ad9f-7b8f-4989-9a45-c9c7788e3a7a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Dec 15 16:38:32.970902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 999/1786] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:38:32.980100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-213ecb17-3be2-4cd5-b48b-69974f571281 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:32.989043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-213ecb17-3be2-4cd5-b48b-69974f571281 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.086745 Dec 15 16:38:32.989623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 788/1787] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:33.982899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c409ea6a-cbd4-4053-acb8-d72e5ec1aa00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:33.983803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c409ea6a-cbd4-4053-acb8-d72e5ec1aa00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:33.990471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c409ea6a-cbd4-4053-acb8-d72e5ec1aa00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:33.990916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c409ea6a-cbd4-4053-acb8-d72e5ec1aa00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:33.991707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c409ea6a-cbd4-4053-acb8-d72e5ec1aa00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:33.992136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c409ea6a-cbd4-4053-acb8-d72e5ec1aa00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:34.007152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-42d08ca6-1a3c-4fb9-ab87-f98926ebbb8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:34.007933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-42d08ca6-1a3c-4fb9-ab87-f98926ebbb8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:34.014802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42d08ca6-1a3c-4fb9-ab87-f98926ebbb8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:34.015256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42d08ca6-1a3c-4fb9-ab87-f98926ebbb8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:34.016056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42d08ca6-1a3c-4fb9-ab87-f98926ebbb8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:34.016523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-42d08ca6-1a3c-4fb9-ab87-f98926ebbb8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:34.022999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c409ea6a-cbd4-4053-acb8-d72e5ec1aa00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 Dec 15 16:38:34.023584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1000/1788] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:33 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:34.084395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-42d08ca6-1a3c-4fb9-ab87-f98926ebbb8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:34.092977 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-42d08ca6-1a3c-4fb9-ab87-f98926ebbb8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089527 Dec 15 16:38:34.093557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 789/1789] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:34 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:35.037583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fd31e241-9186-4858-b5a1-d0d4ae774c18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:35.038490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fd31e241-9186-4858-b5a1-d0d4ae774c18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:35.045404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd31e241-9186-4858-b5a1-d0d4ae774c18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:35.045876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd31e241-9186-4858-b5a1-d0d4ae774c18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:35.046664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd31e241-9186-4858-b5a1-d0d4ae774c18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:35.047097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fd31e241-9186-4858-b5a1-d0d4ae774c18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:35.077894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fd31e241-9186-4858-b5a1-d0d4ae774c18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044094 Dec 15 16:38:35.078723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1001/1790] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:35.109462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e5b0a270-b1bd-4f07-9c77-f54586ba74a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:35.110060 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e5b0a270-b1bd-4f07-9c77-f54586ba74a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:35.116894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e5b0a270-b1bd-4f07-9c77-f54586ba74a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:35.117342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e5b0a270-b1bd-4f07-9c77-f54586ba74a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:35.118125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e5b0a270-b1bd-4f07-9c77-f54586ba74a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:35.118560 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e5b0a270-b1bd-4f07-9c77-f54586ba74a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:35.181978 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e5b0a270-b1bd-4f07-9c77-f54586ba74a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:35.190206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e5b0a270-b1bd-4f07-9c77-f54586ba74a9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.084460 Dec 15 16:38:35.190780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 790/1791] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:35 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:36.089264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4595b418-2092-4097-9ed6-0fc17da8dca6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:36.090167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4595b418-2092-4097-9ed6-0fc17da8dca6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:36.098097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4595b418-2092-4097-9ed6-0fc17da8dca6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:36.098550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4595b418-2092-4097-9ed6-0fc17da8dca6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:36.099339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4595b418-2092-4097-9ed6-0fc17da8dca6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:36.099773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4595b418-2092-4097-9ed6-0fc17da8dca6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:36.130938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4595b418-2092-4097-9ed6-0fc17da8dca6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Dec 15 16:38:36.131518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1002/1792] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:36.207455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-33170a77-4987-4b2e-a20e-bec59f42a90e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:36.208026 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-33170a77-4987-4b2e-a20e-bec59f42a90e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:36.214681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33170a77-4987-4b2e-a20e-bec59f42a90e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:36.215125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33170a77-4987-4b2e-a20e-bec59f42a90e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:36.216274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33170a77-4987-4b2e-a20e-bec59f42a90e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:36.216900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33170a77-4987-4b2e-a20e-bec59f42a90e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:36.279443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-33170a77-4987-4b2e-a20e-bec59f42a90e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:36.287690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-33170a77-4987-4b2e-a20e-bec59f42a90e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.084116 Dec 15 16:38:36.288265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 791/1793] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:36 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:37.143212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eaaa4fd0-7a66-484d-a5ce-6e1dad6c6d75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:37.144125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eaaa4fd0-7a66-484d-a5ce-6e1dad6c6d75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:37.150976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eaaa4fd0-7a66-484d-a5ce-6e1dad6c6d75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:37.151433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eaaa4fd0-7a66-484d-a5ce-6e1dad6c6d75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:37.152218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eaaa4fd0-7a66-484d-a5ce-6e1dad6c6d75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:37.152695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eaaa4fd0-7a66-484d-a5ce-6e1dad6c6d75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:37.183799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eaaa4fd0-7a66-484d-a5ce-6e1dad6c6d75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044604 Dec 15 16:38:37.184373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1003/1794] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:37.305715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b66a2e8f-f846-42cf-8100-2b1f469617bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:37.306351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b66a2e8f-f846-42cf-8100-2b1f469617bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:37.313746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b66a2e8f-f846-42cf-8100-2b1f469617bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:37.314438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b66a2e8f-f846-42cf-8100-2b1f469617bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:37.315258 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b66a2e8f-f846-42cf-8100-2b1f469617bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:37.315699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b66a2e8f-f846-42cf-8100-2b1f469617bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:37.378396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b66a2e8f-f846-42cf-8100-2b1f469617bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:37.386066 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b66a2e8f-f846-42cf-8100-2b1f469617bb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.084122 Dec 15 16:38:37.386648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 792/1795] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:37 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:38.196557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a6d2d4ad-c4d8-4b90-9518-09a47ca6467a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:38.197243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a6d2d4ad-c4d8-4b90-9518-09a47ca6467a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:38.205619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6d2d4ad-c4d8-4b90-9518-09a47ca6467a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:38.206158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6d2d4ad-c4d8-4b90-9518-09a47ca6467a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:38.207105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6d2d4ad-c4d8-4b90-9518-09a47ca6467a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:38.207692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6d2d4ad-c4d8-4b90-9518-09a47ca6467a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:38.247478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a6d2d4ad-c4d8-4b90-9518-09a47ca6467a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055484 Dec 15 16:38:38.248348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1004/1796] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:38.407849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1e91dacc-48bb-4b39-a275-a129be46b1c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:38.408678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1e91dacc-48bb-4b39-a275-a129be46b1c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:38.419284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e91dacc-48bb-4b39-a275-a129be46b1c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:38.419968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e91dacc-48bb-4b39-a275-a129be46b1c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:38.421298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e91dacc-48bb-4b39-a275-a129be46b1c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:38.421998 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e91dacc-48bb-4b39-a275-a129be46b1c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:38.482178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1e91dacc-48bb-4b39-a275-a129be46b1c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:38.490581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1e91dacc-48bb-4b39-a275-a129be46b1c6 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088878 Dec 15 16:38:38.491172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 793/1797] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:38 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:38:39.259445 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4cfaac78-3a10-452f-94a0-e2316d31d604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:39.260347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4cfaac78-3a10-452f-94a0-e2316d31d604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:39.267441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cfaac78-3a10-452f-94a0-e2316d31d604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:39.267897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cfaac78-3a10-452f-94a0-e2316d31d604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:39.268722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cfaac78-3a10-452f-94a0-e2316d31d604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:39.269158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cfaac78-3a10-452f-94a0-e2316d31d604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:39.298841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4cfaac78-3a10-452f-94a0-e2316d31d604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043203 Dec 15 16:38:39.299431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1005/1798] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:39 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:39.507846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fe76c07a-58cf-406e-a61a-e8be6e409ee8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:39.508465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fe76c07a-58cf-406e-a61a-e8be6e409ee8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:39.515213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe76c07a-58cf-406e-a61a-e8be6e409ee8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:39.515667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe76c07a-58cf-406e-a61a-e8be6e409ee8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:39.516572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe76c07a-58cf-406e-a61a-e8be6e409ee8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:39.517205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe76c07a-58cf-406e-a61a-e8be6e409ee8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:39.578360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fe76c07a-58cf-406e-a61a-e8be6e409ee8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:39.586890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fe76c07a-58cf-406e-a61a-e8be6e409ee8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.082872 Dec 15 16:38:39.587494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 794/1799] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:39 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:40.312155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-583012a8-86a3-4055-b807-f4027465a9aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:40.313473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-583012a8-86a3-4055-b807-f4027465a9aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:40.320263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-583012a8-86a3-4055-b807-f4027465a9aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:40.320745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-583012a8-86a3-4055-b807-f4027465a9aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:40.321532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-583012a8-86a3-4055-b807-f4027465a9aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:40.321986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-583012a8-86a3-4055-b807-f4027465a9aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:40.352569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-583012a8-86a3-4055-b807-f4027465a9aa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Dec 15 16:38:40.353181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1006/1800] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:40.605657 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-988d4a2d-b772-4c7c-9bf0-d286081cbe3e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:40.606270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-988d4a2d-b772-4c7c-9bf0-d286081cbe3e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:40.613821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-988d4a2d-b772-4c7c-9bf0-d286081cbe3e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:40.614590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-988d4a2d-b772-4c7c-9bf0-d286081cbe3e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:40.615402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-988d4a2d-b772-4c7c-9bf0-d286081cbe3e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:40.616242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-988d4a2d-b772-4c7c-9bf0-d286081cbe3e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:40.686929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-988d4a2d-b772-4c7c-9bf0-d286081cbe3e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:40.695457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-988d4a2d-b772-4c7c-9bf0-d286081cbe3e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.094129 Dec 15 16:38:40.696056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 795/1801] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:40 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:41.364771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-133f5b68-6421-468e-bc43-56021ab5b6b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:41.365719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-133f5b68-6421-468e-bc43-56021ab5b6b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:41.372884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-133f5b68-6421-468e-bc43-56021ab5b6b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:41.373322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-133f5b68-6421-468e-bc43-56021ab5b6b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:41.374182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-133f5b68-6421-468e-bc43-56021ab5b6b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:41.374553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-133f5b68-6421-468e-bc43-56021ab5b6b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:41.405589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-133f5b68-6421-468e-bc43-56021ab5b6b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Dec 15 16:38:41.406125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1007/1802] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:41.713693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-337836d0-2029-4031-8f9b-a64558533ee2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:41.715031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-337836d0-2029-4031-8f9b-a64558533ee2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:41.722588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-337836d0-2029-4031-8f9b-a64558533ee2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:41.723033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-337836d0-2029-4031-8f9b-a64558533ee2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:41.723818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-337836d0-2029-4031-8f9b-a64558533ee2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:41.724400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-337836d0-2029-4031-8f9b-a64558533ee2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:41.795550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-337836d0-2029-4031-8f9b-a64558533ee2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:41.803204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-337836d0-2029-4031-8f9b-a64558533ee2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.093267 Dec 15 16:38:41.803790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 796/1803] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:41 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:42.419341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-460ab071-2960-4ee3-ad73-a78b3c677842 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:42.420494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-460ab071-2960-4ee3-ad73-a78b3c677842 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:42.428059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-460ab071-2960-4ee3-ad73-a78b3c677842 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:42.428538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-460ab071-2960-4ee3-ad73-a78b3c677842 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:42.429346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-460ab071-2960-4ee3-ad73-a78b3c677842 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:42.429749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-460ab071-2960-4ee3-ad73-a78b3c677842 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:42.462028 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-460ab071-2960-4ee3-ad73-a78b3c677842 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048176 Dec 15 16:38:42.462598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1008/1804] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:42.820444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dc5656be-d5cb-4b82-b222-219ef224a124 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:42.821113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dc5656be-d5cb-4b82-b222-219ef224a124 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:42.829527 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dc5656be-d5cb-4b82-b222-219ef224a124 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:42.829975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dc5656be-d5cb-4b82-b222-219ef224a124 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:42.830767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dc5656be-d5cb-4b82-b222-219ef224a124 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:42.831193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dc5656be-d5cb-4b82-b222-219ef224a124 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:42.901769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dc5656be-d5cb-4b82-b222-219ef224a124 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:42.909536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dc5656be-d5cb-4b82-b222-219ef224a124 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.092822 Dec 15 16:38:42.910107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 797/1805] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:42 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:43.475086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-817dc9bd-9c96-48cd-98db-480dda48ec9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:43.475885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-817dc9bd-9c96-48cd-98db-480dda48ec9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:43.482479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-817dc9bd-9c96-48cd-98db-480dda48ec9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:43.482927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-817dc9bd-9c96-48cd-98db-480dda48ec9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:43.483711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-817dc9bd-9c96-48cd-98db-480dda48ec9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:43.484138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-817dc9bd-9c96-48cd-98db-480dda48ec9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:43.515924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-817dc9bd-9c96-48cd-98db-480dda48ec9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Dec 15 16:38:43.516515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1009/1806] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:43.927068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6a6a8970-5f4d-4398-8b53-41f09a8c8c11 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:43.927707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6a6a8970-5f4d-4398-8b53-41f09a8c8c11 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:43.934407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a6a8970-5f4d-4398-8b53-41f09a8c8c11 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:43.934826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a6a8970-5f4d-4398-8b53-41f09a8c8c11 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:43.935635 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a6a8970-5f4d-4398-8b53-41f09a8c8c11 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:43.936061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6a6a8970-5f4d-4398-8b53-41f09a8c8c11 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:43.999149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6a6a8970-5f4d-4398-8b53-41f09a8c8c11 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:44.007443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6a6a8970-5f4d-4398-8b53-41f09a8c8c11 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.084411 Dec 15 16:38:44.008021 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 798/1807] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:43 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:44.529764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7ca7faf1-b7ca-4474-9447-0bb290213320 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:44.531062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7ca7faf1-b7ca-4474-9447-0bb290213320 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:44.540201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ca7faf1-b7ca-4474-9447-0bb290213320 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:44.540910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ca7faf1-b7ca-4474-9447-0bb290213320 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:44.542052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ca7faf1-b7ca-4474-9447-0bb290213320 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:44.542490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ca7faf1-b7ca-4474-9447-0bb290213320 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:44.573067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7ca7faf1-b7ca-4474-9447-0bb290213320 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048980 Dec 15 16:38:44.573624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1010/1808] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:45.026283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-08bc1b6f-3c9f-4d92-a25a-71e32c2036a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:45.026903 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-08bc1b6f-3c9f-4d92-a25a-71e32c2036a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:45.034395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08bc1b6f-3c9f-4d92-a25a-71e32c2036a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:45.034841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08bc1b6f-3c9f-4d92-a25a-71e32c2036a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:45.035632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08bc1b6f-3c9f-4d92-a25a-71e32c2036a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:45.036070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08bc1b6f-3c9f-4d92-a25a-71e32c2036a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:45.098916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-08bc1b6f-3c9f-4d92-a25a-71e32c2036a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:45.112067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-08bc1b6f-3c9f-4d92-a25a-71e32c2036a2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089802 Dec 15 16:38:45.112911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 799/1809] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:45 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:45.585866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ec5f37e6-b27d-4793-b2f5-af95c8bd5819 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:45.586885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ec5f37e6-b27d-4793-b2f5-af95c8bd5819 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:45.594959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e6-b27d-4793-b2f5-af95c8bd5819 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:45.595508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e6-b27d-4793-b2f5-af95c8bd5819 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:45.596422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e6-b27d-4793-b2f5-af95c8bd5819 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:45.597210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ec5f37e6-b27d-4793-b2f5-af95c8bd5819 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:45.629180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ec5f37e6-b27d-4793-b2f5-af95c8bd5819 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047748 Dec 15 16:38:45.629760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1011/1810] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:46.134095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1abb61af-e326-48d8-a159-a40c72584637 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:46.135069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1abb61af-e326-48d8-a159-a40c72584637 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:46.145655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1abb61af-e326-48d8-a159-a40c72584637 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:46.146037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1abb61af-e326-48d8-a159-a40c72584637 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:46.146823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1abb61af-e326-48d8-a159-a40c72584637 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:46.147258 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1abb61af-e326-48d8-a159-a40c72584637 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:46.207799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1abb61af-e326-48d8-a159-a40c72584637 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:46.216005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1abb61af-e326-48d8-a159-a40c72584637 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088649 Dec 15 16:38:46.216592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 800/1811] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:46 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:46.644456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7e36b817-1adb-4844-9bf8-d17d2224f04a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:46.645380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7e36b817-1adb-4844-9bf8-d17d2224f04a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:46.652364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e36b817-1adb-4844-9bf8-d17d2224f04a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:46.652832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e36b817-1adb-4844-9bf8-d17d2224f04a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:46.653622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e36b817-1adb-4844-9bf8-d17d2224f04a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:46.654051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7e36b817-1adb-4844-9bf8-d17d2224f04a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:46.686168 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7e36b817-1adb-4844-9bf8-d17d2224f04a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Dec 15 16:38:46.686736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1012/1812] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:47.234281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c377922a-9463-45e8-a403-7f90f030bc8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:47.234898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c377922a-9463-45e8-a403-7f90f030bc8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:47.241818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c377922a-9463-45e8-a403-7f90f030bc8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:47.242296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c377922a-9463-45e8-a403-7f90f030bc8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:47.243087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c377922a-9463-45e8-a403-7f90f030bc8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:47.243522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c377922a-9463-45e8-a403-7f90f030bc8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:47.312817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c377922a-9463-45e8-a403-7f90f030bc8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:47.323936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c377922a-9463-45e8-a403-7f90f030bc8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.093107 Dec 15 16:38:47.324809 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 801/1813] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:47 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:47.699090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-14b27d9a-5058-4971-bf25-e9ed2100ebee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:47.700015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-14b27d9a-5058-4971-bf25-e9ed2100ebee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:47.706791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14b27d9a-5058-4971-bf25-e9ed2100ebee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:47.707746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14b27d9a-5058-4971-bf25-e9ed2100ebee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:47.708037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14b27d9a-5058-4971-bf25-e9ed2100ebee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:47.708463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14b27d9a-5058-4971-bf25-e9ed2100ebee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:47.740155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-14b27d9a-5058-4971-bf25-e9ed2100ebee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 Dec 15 16:38:47.741416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1013/1814] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:47 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:48.344219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c56c48e4-0053-450e-bfc1-43adea800d21 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:48.344884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c56c48e4-0053-450e-bfc1-43adea800d21 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:48.354097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c56c48e4-0053-450e-bfc1-43adea800d21 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:48.354592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c56c48e4-0053-450e-bfc1-43adea800d21 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:48.355748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c56c48e4-0053-450e-bfc1-43adea800d21 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:48.356372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c56c48e4-0053-450e-bfc1-43adea800d21 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:48.421174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c56c48e4-0053-450e-bfc1-43adea800d21 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:48.429035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c56c48e4-0053-450e-bfc1-43adea800d21 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088962 Dec 15 16:38:48.429604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 802/1815] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:48 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:48.753102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-60bebfe6-9358-4efe-ab54-bea10cad9ff2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:48.753941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-60bebfe6-9358-4efe-ab54-bea10cad9ff2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:48.761120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60bebfe6-9358-4efe-ab54-bea10cad9ff2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:48.761539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60bebfe6-9358-4efe-ab54-bea10cad9ff2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:48.762343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60bebfe6-9358-4efe-ab54-bea10cad9ff2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:48.762777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-60bebfe6-9358-4efe-ab54-bea10cad9ff2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:48.801060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-60bebfe6-9358-4efe-ab54-bea10cad9ff2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051407 Dec 15 16:38:48.801968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1014/1816] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:49.451327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8b1ebbed-566d-4ffd-adb1-11d4be8aa400 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:49.451930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8b1ebbed-566d-4ffd-adb1-11d4be8aa400 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:49.458701 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b1ebbed-566d-4ffd-adb1-11d4be8aa400 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:49.459154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b1ebbed-566d-4ffd-adb1-11d4be8aa400 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:49.459952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b1ebbed-566d-4ffd-adb1-11d4be8aa400 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:49.460389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b1ebbed-566d-4ffd-adb1-11d4be8aa400 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:49.523896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8b1ebbed-566d-4ffd-adb1-11d4be8aa400 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:49.531808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8b1ebbed-566d-4ffd-adb1-11d4be8aa400 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.084391 Dec 15 16:38:49.532383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 803/1817] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:49 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:49.815042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9602ccac-d32c-4b65-85d0-9170ff918ddb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:49.815982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9602ccac-d32c-4b65-85d0-9170ff918ddb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:49.822930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9602ccac-d32c-4b65-85d0-9170ff918ddb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:49.823380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9602ccac-d32c-4b65-85d0-9170ff918ddb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:49.824174 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9602ccac-d32c-4b65-85d0-9170ff918ddb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:49.824645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9602ccac-d32c-4b65-85d0-9170ff918ddb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:49.856712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9602ccac-d32c-4b65-85d0-9170ff918ddb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Dec 15 16:38:49.857277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1015/1818] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:50.552358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-27893000-8059-4d75-a7ae-7907b336601e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:50.552984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-27893000-8059-4d75-a7ae-7907b336601e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:50.559858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27893000-8059-4d75-a7ae-7907b336601e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:50.560344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27893000-8059-4d75-a7ae-7907b336601e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:50.561190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27893000-8059-4d75-a7ae-7907b336601e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:50.561629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27893000-8059-4d75-a7ae-7907b336601e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:50.625999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-27893000-8059-4d75-a7ae-7907b336601e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:50.634015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-27893000-8059-4d75-a7ae-7907b336601e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.085950 Dec 15 16:38:50.634612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 804/1819] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:50 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:50.871974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-36e71a89-bc98-49c7-9fbc-7ee9950b5213 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:50.873056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-36e71a89-bc98-49c7-9fbc-7ee9950b5213 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:50.881712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36e71a89-bc98-49c7-9fbc-7ee9950b5213 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:50.882155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36e71a89-bc98-49c7-9fbc-7ee9950b5213 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:50.882937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36e71a89-bc98-49c7-9fbc-7ee9950b5213 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:50.883361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36e71a89-bc98-49c7-9fbc-7ee9950b5213 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:50.912593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-36e71a89-bc98-49c7-9fbc-7ee9950b5213 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Dec 15 16:38:50.913146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1016/1820] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:51.654400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6290cf6a-365e-477b-bc3c-97c517064f65 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:51.654996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6290cf6a-365e-477b-bc3c-97c517064f65 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:51.662430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6290cf6a-365e-477b-bc3c-97c517064f65 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:51.662896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6290cf6a-365e-477b-bc3c-97c517064f65 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:51.663693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6290cf6a-365e-477b-bc3c-97c517064f65 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:51.664123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6290cf6a-365e-477b-bc3c-97c517064f65 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:51.737143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6290cf6a-365e-477b-bc3c-97c517064f65 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:51.745742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6290cf6a-365e-477b-bc3c-97c517064f65 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.097233 Dec 15 16:38:51.746314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 805/1821] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:51 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:51.923670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2eb81d90-48bf-49c3-95f2-077dfbfad8cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:51.924593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2eb81d90-48bf-49c3-95f2-077dfbfad8cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:51.931365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2eb81d90-48bf-49c3-95f2-077dfbfad8cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:51.931808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2eb81d90-48bf-49c3-95f2-077dfbfad8cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:51.932619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2eb81d90-48bf-49c3-95f2-077dfbfad8cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:51.933047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2eb81d90-48bf-49c3-95f2-077dfbfad8cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:51.962346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2eb81d90-48bf-49c3-95f2-077dfbfad8cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042606 Dec 15 16:38:51.962870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1017/1822] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:52.767946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-514bbe6f-3157-4762-8e30-410b0976a80a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:52.768670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-514bbe6f-3157-4762-8e30-410b0976a80a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:52.775870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-514bbe6f-3157-4762-8e30-410b0976a80a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:52.776320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-514bbe6f-3157-4762-8e30-410b0976a80a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:52.777147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-514bbe6f-3157-4762-8e30-410b0976a80a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:52.777585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-514bbe6f-3157-4762-8e30-410b0976a80a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:52.840088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-514bbe6f-3157-4762-8e30-410b0976a80a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:52.850268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-514bbe6f-3157-4762-8e30-410b0976a80a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.086354 Dec 15 16:38:52.850852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 806/1823] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:52 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:52.976871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2213b80b-5d2c-4dfb-bf17-ebd87ae332b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:52.977772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2213b80b-5d2c-4dfb-bf17-ebd87ae332b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:52.984668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2213b80b-5d2c-4dfb-bf17-ebd87ae332b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:52.985121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2213b80b-5d2c-4dfb-bf17-ebd87ae332b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:52.985901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2213b80b-5d2c-4dfb-bf17-ebd87ae332b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:52.986316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2213b80b-5d2c-4dfb-bf17-ebd87ae332b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:53.023155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2213b80b-5d2c-4dfb-bf17-ebd87ae332b3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051366 Dec 15 16:38:53.023629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1018/1824] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:53.867255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fa99bdfa-a537-459f-aeac-78b196683bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:53.867906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fa99bdfa-a537-459f-aeac-78b196683bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:53.874443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa99bdfa-a537-459f-aeac-78b196683bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:53.874888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa99bdfa-a537-459f-aeac-78b196683bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:53.875672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa99bdfa-a537-459f-aeac-78b196683bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:53.876102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa99bdfa-a537-459f-aeac-78b196683bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:53.936585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fa99bdfa-a537-459f-aeac-78b196683bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:53.944713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fa99bdfa-a537-459f-aeac-78b196683bcf tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.081195 Dec 15 16:38:53.945316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 807/1825] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:53 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:54.038846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5c5de52e-ca6e-4d73-bae4-9b65db8e7a93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:54.039763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5c5de52e-ca6e-4d73-bae4-9b65db8e7a93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:54.049147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c5de52e-ca6e-4d73-bae4-9b65db8e7a93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:54.049653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c5de52e-ca6e-4d73-bae4-9b65db8e7a93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:54.050438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c5de52e-ca6e-4d73-bae4-9b65db8e7a93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:54.050989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c5de52e-ca6e-4d73-bae4-9b65db8e7a93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:54.083279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5c5de52e-ca6e-4d73-bae4-9b65db8e7a93 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051059 Dec 15 16:38:54.083854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1019/1826] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:54 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:54.964326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ccf3109d-e6c5-4f91-b86d-0d29cd1edd89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:54.965000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ccf3109d-e6c5-4f91-b86d-0d29cd1edd89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:54.972365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccf3109d-e6c5-4f91-b86d-0d29cd1edd89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:54.972838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccf3109d-e6c5-4f91-b86d-0d29cd1edd89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:54.973644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccf3109d-e6c5-4f91-b86d-0d29cd1edd89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:54.974075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccf3109d-e6c5-4f91-b86d-0d29cd1edd89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:55.041616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ccf3109d-e6c5-4f91-b86d-0d29cd1edd89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:55.049094 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ccf3109d-e6c5-4f91-b86d-0d29cd1edd89 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089327 Dec 15 16:38:55.049685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 808/1827] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:54 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:55.099381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e3ec365d-4e5e-4f05-b079-f4dbfa5da9bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:55.100482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e3ec365d-4e5e-4f05-b079-f4dbfa5da9bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:55.107748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e3ec365d-4e5e-4f05-b079-f4dbfa5da9bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:55.108186 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e3ec365d-4e5e-4f05-b079-f4dbfa5da9bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:55.109012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e3ec365d-4e5e-4f05-b079-f4dbfa5da9bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:55.109467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e3ec365d-4e5e-4f05-b079-f4dbfa5da9bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:55.139848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e3ec365d-4e5e-4f05-b079-f4dbfa5da9bc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046268 Dec 15 16:38:55.140416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1020/1828] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:56.065521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b1c83c52-089e-4bd9-a4e1-bdb23f233764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:56.066130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b1c83c52-089e-4bd9-a4e1-bdb23f233764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:56.073062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1c83c52-089e-4bd9-a4e1-bdb23f233764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:56.073509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1c83c52-089e-4bd9-a4e1-bdb23f233764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:56.074289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1c83c52-089e-4bd9-a4e1-bdb23f233764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:56.074717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1c83c52-089e-4bd9-a4e1-bdb23f233764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:56.135609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b1c83c52-089e-4bd9-a4e1-bdb23f233764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:56.143358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b1c83c52-089e-4bd9-a4e1-bdb23f233764 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.081500 Dec 15 16:38:56.143916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 809/1829] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:56 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:56.151837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d5423b98-2a88-4fcc-928c-eb6b2944ad88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:56.152817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d5423b98-2a88-4fcc-928c-eb6b2944ad88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:56.159572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5423b98-2a88-4fcc-928c-eb6b2944ad88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:56.160005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5423b98-2a88-4fcc-928c-eb6b2944ad88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:56.160900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5423b98-2a88-4fcc-928c-eb6b2944ad88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:56.161263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5423b98-2a88-4fcc-928c-eb6b2944ad88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:56.192780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d5423b98-2a88-4fcc-928c-eb6b2944ad88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Dec 15 16:38:56.193381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1021/1830] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:57.161332 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fbe958e5-5ac7-4f75-9c9d-0b4c0cd344d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:57.161901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fbe958e5-5ac7-4f75-9c9d-0b4c0cd344d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:57.168829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbe958e5-5ac7-4f75-9c9d-0b4c0cd344d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:57.169281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbe958e5-5ac7-4f75-9c9d-0b4c0cd344d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:57.170056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbe958e5-5ac7-4f75-9c9d-0b4c0cd344d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:57.170490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fbe958e5-5ac7-4f75-9c9d-0b4c0cd344d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:57.205258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cb67d501-aca2-4b18-be61-919500fc2820 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:57.206072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cb67d501-aca2-4b18-be61-919500fc2820 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:57.212879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb67d501-aca2-4b18-be61-919500fc2820 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:57.213328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb67d501-aca2-4b18-be61-919500fc2820 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:57.214118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb67d501-aca2-4b18-be61-919500fc2820 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:57.214546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb67d501-aca2-4b18-be61-919500fc2820 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:57.230801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fbe958e5-5ac7-4f75-9c9d-0b4c0cd344d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:57.239270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fbe958e5-5ac7-4f75-9c9d-0b4c0cd344d2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.081686 Dec 15 16:38:57.239851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 810/1831] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:57 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:57.246082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cb67d501-aca2-4b18-be61-919500fc2820 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Dec 15 16:38:57.246682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1022/1832] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:58.256865 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-31c77f47-190c-4a01-9e5a-37c86e0c8675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:58.257439 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-82702f46-f972-4ca7-adc6-d4a96ff38e2f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:58.257922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-31c77f47-190c-4a01-9e5a-37c86e0c8675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:58.258034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-82702f46-f972-4ca7-adc6-d4a96ff38e2f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:58.264097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31c77f47-190c-4a01-9e5a-37c86e0c8675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:58.264386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82702f46-f972-4ca7-adc6-d4a96ff38e2f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:58.264578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31c77f47-190c-4a01-9e5a-37c86e0c8675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:58.264872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82702f46-f972-4ca7-adc6-d4a96ff38e2f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:58.265345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31c77f47-190c-4a01-9e5a-37c86e0c8675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:58.265655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82702f46-f972-4ca7-adc6-d4a96ff38e2f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:58.265820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-31c77f47-190c-4a01-9e5a-37c86e0c8675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:58.266115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82702f46-f972-4ca7-adc6-d4a96ff38e2f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:58.296211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-82702f46-f972-4ca7-adc6-d4a96ff38e2f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Dec 15 16:38:58.296814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1023/1833] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:58.328369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-31c77f47-190c-4a01-9e5a-37c86e0c8675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:58.338984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-31c77f47-190c-4a01-9e5a-37c86e0c8675 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.085726 Dec 15 16:38:58.339709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 811/1834] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:58 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:38:59.308174 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f3d094cb-584d-4fc5-9df6-f113d5f7c407 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:59.309115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f3d094cb-584d-4fc5-9df6-f113d5f7c407 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:59.316267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f3d094cb-584d-4fc5-9df6-f113d5f7c407 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:59.316863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f3d094cb-584d-4fc5-9df6-f113d5f7c407 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:59.317879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f3d094cb-584d-4fc5-9df6-f113d5f7c407 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:59.318322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f3d094cb-584d-4fc5-9df6-f113d5f7c407 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:59.354015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f3d094cb-584d-4fc5-9df6-f113d5f7c407 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049738 Dec 15 16:38:59.354579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1024/1835] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:38:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:38:59.356756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-75e66131-fabf-4291-9fa4-1b36d24b19fb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:38:59.357409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-75e66131-fabf-4291-9fa4-1b36d24b19fb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:38:59.366819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-75e66131-fabf-4291-9fa4-1b36d24b19fb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:59.367464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-75e66131-fabf-4291-9fa4-1b36d24b19fb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:59.368400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-75e66131-fabf-4291-9fa4-1b36d24b19fb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:38:59.368867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-75e66131-fabf-4291-9fa4-1b36d24b19fb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:38:59.437157 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-75e66131-fabf-4291-9fa4-1b36d24b19fb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:38:59.445442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-75e66131-fabf-4291-9fa4-1b36d24b19fb tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.092484 Dec 15 16:38:59.446017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 812/1836] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:38:59 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:00.368869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5e06713e-3c8b-4bff-83ab-86acfeb5dc6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:00.369893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5e06713e-3c8b-4bff-83ab-86acfeb5dc6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:00.379547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e06713e-3c8b-4bff-83ab-86acfeb5dc6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:00.380143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e06713e-3c8b-4bff-83ab-86acfeb5dc6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:00.381274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e06713e-3c8b-4bff-83ab-86acfeb5dc6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:00.381862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e06713e-3c8b-4bff-83ab-86acfeb5dc6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:00.413726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5e06713e-3c8b-4bff-83ab-86acfeb5dc6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050677 Dec 15 16:39:00.414371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1025/1837] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:39:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:39:00.462688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-29107cea-2ddf-4ef5-8504-e5afe1f6cc7a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:00.463260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-29107cea-2ddf-4ef5-8504-e5afe1f6cc7a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:00.470100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-29107cea-2ddf-4ef5-8504-e5afe1f6cc7a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:00.470546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-29107cea-2ddf-4ef5-8504-e5afe1f6cc7a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:00.471322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-29107cea-2ddf-4ef5-8504-e5afe1f6cc7a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:00.471756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-29107cea-2ddf-4ef5-8504-e5afe1f6cc7a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:00.536414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-29107cea-2ddf-4ef5-8504-e5afe1f6cc7a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:00.545690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-29107cea-2ddf-4ef5-8504-e5afe1f6cc7a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.086905 Dec 15 16:39:00.546237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 813/1838] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:00 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:01.429320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d28e4552-f3d8-4130-bbb3-235369ab3d79 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:01.430881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d28e4552-f3d8-4130-bbb3-235369ab3d79 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:01.437698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d28e4552-f3d8-4130-bbb3-235369ab3d79 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:01.438138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d28e4552-f3d8-4130-bbb3-235369ab3d79 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:01.438916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d28e4552-f3d8-4130-bbb3-235369ab3d79 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:01.439360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d28e4552-f3d8-4130-bbb3-235369ab3d79 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:01.471986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d28e4552-f3d8-4130-bbb3-235369ab3d79 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047542 Dec 15 16:39:01.472590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1026/1839] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:39:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:39:01.562623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9a44cee5-84c9-498c-ad61-010dcc1f5b80 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:01.563247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9a44cee5-84c9-498c-ad61-010dcc1f5b80 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:01.569972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a44cee5-84c9-498c-ad61-010dcc1f5b80 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:01.570418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a44cee5-84c9-498c-ad61-010dcc1f5b80 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:01.571509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a44cee5-84c9-498c-ad61-010dcc1f5b80 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:01.571954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a44cee5-84c9-498c-ad61-010dcc1f5b80 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:01.639022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9a44cee5-84c9-498c-ad61-010dcc1f5b80 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:01.647503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9a44cee5-84c9-498c-ad61-010dcc1f5b80 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088531 Dec 15 16:39:01.647972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 814/1840] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:01 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:02.486696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-100aa583-d682-4db4-b2a9-71906287615c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:02.487719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-100aa583-d682-4db4-b2a9-71906287615c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:02.495249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-100aa583-d682-4db4-b2a9-71906287615c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:02.495674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-100aa583-d682-4db4-b2a9-71906287615c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:02.496476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-100aa583-d682-4db4-b2a9-71906287615c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:02.496937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-100aa583-d682-4db4-b2a9-71906287615c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:02.526976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-100aa583-d682-4db4-b2a9-71906287615c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Dec 15 16:39:02.527540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1027/1841] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:39:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:39:02.666553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7d2956d7-d0de-413d-b054-07567100c698 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:02.667689 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7d2956d7-d0de-413d-b054-07567100c698 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:02.675438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d2956d7-d0de-413d-b054-07567100c698 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:02.675890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d2956d7-d0de-413d-b054-07567100c698 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:02.676718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d2956d7-d0de-413d-b054-07567100c698 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:02.677157 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d2956d7-d0de-413d-b054-07567100c698 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:02.746354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7d2956d7-d0de-413d-b054-07567100c698 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:02.762398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7d2956d7-d0de-413d-b054-07567100c698 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.101281 Dec 15 16:39:02.763020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 815/1842] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:02 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:03.044674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:39:03.044927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:39:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:39:03.542576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d39b3e96-d02f-4ca4-ac88-3b4eeddf4113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:03.543500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d39b3e96-d02f-4ca4-ac88-3b4eeddf4113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:03.550154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d39b3e96-d02f-4ca4-ac88-3b4eeddf4113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:03.550613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d39b3e96-d02f-4ca4-ac88-3b4eeddf4113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:03.551415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d39b3e96-d02f-4ca4-ac88-3b4eeddf4113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:03.551866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d39b3e96-d02f-4ca4-ac88-3b4eeddf4113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:03.581904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d39b3e96-d02f-4ca4-ac88-3b4eeddf4113 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Dec 15 16:39:03.582470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1028/1843] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:39:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:39:03.785283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ae035fa1-d49e-4948-b08c-33c5208592b1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:03.785923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ae035fa1-d49e-4948-b08c-33c5208592b1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:03.792817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae035fa1-d49e-4948-b08c-33c5208592b1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:03.793199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae035fa1-d49e-4948-b08c-33c5208592b1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:03.793976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae035fa1-d49e-4948-b08c-33c5208592b1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:03.794404 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae035fa1-d49e-4948-b08c-33c5208592b1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:03.862774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ae035fa1-d49e-4948-b08c-33c5208592b1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:03.871824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ae035fa1-d49e-4948-b08c-33c5208592b1 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.090358 Dec 15 16:39:03.872419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 816/1844] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:03 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:04.596627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-66cb2d20-8493-4c2a-bfd6-f2c06d02aac0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:04.597720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-66cb2d20-8493-4c2a-bfd6-f2c06d02aac0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:04.607362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66cb2d20-8493-4c2a-bfd6-f2c06d02aac0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:04.607864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66cb2d20-8493-4c2a-bfd6-f2c06d02aac0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:04.609053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66cb2d20-8493-4c2a-bfd6-f2c06d02aac0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:04.609606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66cb2d20-8493-4c2a-bfd6-f2c06d02aac0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:04.642943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-66cb2d20-8493-4c2a-bfd6-f2c06d02aac0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052477 Dec 15 16:39:04.643800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1029/1845] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:39:04 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:39:04.888696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c5433c14-3593-4d05-aa8e-2562e7744785 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:04.889290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c5433c14-3593-4d05-aa8e-2562e7744785 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:04.896460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5433c14-3593-4d05-aa8e-2562e7744785 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:04.896908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5433c14-3593-4d05-aa8e-2562e7744785 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:04.897690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5433c14-3593-4d05-aa8e-2562e7744785 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:04.898119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5433c14-3593-4d05-aa8e-2562e7744785 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:04.960998 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c5433c14-3593-4d05-aa8e-2562e7744785 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:04.973576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c5433c14-3593-4d05-aa8e-2562e7744785 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088529 Dec 15 16:39:04.974311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 817/1846] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:04 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:05.658078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-653064e5-2e38-4e06-98d0-068658c73d4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:05.659070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-653064e5-2e38-4e06-98d0-068658c73d4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:05.668004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-653064e5-2e38-4e06-98d0-068658c73d4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:05.668459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-653064e5-2e38-4e06-98d0-068658c73d4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:05.669281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-653064e5-2e38-4e06-98d0-068658c73d4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:05.669708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-653064e5-2e38-4e06-98d0-068658c73d4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:05.699910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-653064e5-2e38-4e06-98d0-068658c73d4c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047891 Dec 15 16:39:05.700477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1030/1847] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:39:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:39:05.992246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-400d474f-e9a8-4a13-b810-ef0c85bab4ab tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:05.992877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-400d474f-e9a8-4a13-b810-ef0c85bab4ab tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:05.999691 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-400d474f-e9a8-4a13-b810-ef0c85bab4ab tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:06.000141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-400d474f-e9a8-4a13-b810-ef0c85bab4ab tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:06.000952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-400d474f-e9a8-4a13-b810-ef0c85bab4ab tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:06.001385 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-400d474f-e9a8-4a13-b810-ef0c85bab4ab tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:06.062112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-400d474f-e9a8-4a13-b810-ef0c85bab4ab tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:06.070129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-400d474f-e9a8-4a13-b810-ef0c85bab4ab tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.081727 Dec 15 16:39:06.070705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 818/1848] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:05 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:06.711833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2ed00367-9732-4ee6-a0c9-aac8b652902f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:06.712761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2ed00367-9732-4ee6-a0c9-aac8b652902f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:06.720298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ed00367-9732-4ee6-a0c9-aac8b652902f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:06.720770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ed00367-9732-4ee6-a0c9-aac8b652902f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:06.721554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ed00367-9732-4ee6-a0c9-aac8b652902f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:06.721979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ed00367-9732-4ee6-a0c9-aac8b652902f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:06.751512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2ed00367-9732-4ee6-a0c9-aac8b652902f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Dec 15 16:39:06.752065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1031/1849] 10.222.0.30 () {58 vars in 1301 bytes} [Wed Dec 15 16:39:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:39:07.087411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7f65a871-16c6-49d9-92e1-2219621e9554 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:07.088140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7f65a871-16c6-49d9-92e1-2219621e9554 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:07.095037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f65a871-16c6-49d9-92e1-2219621e9554 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:07.095484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f65a871-16c6-49d9-92e1-2219621e9554 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:07.096264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f65a871-16c6-49d9-92e1-2219621e9554 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:07.096726 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f65a871-16c6-49d9-92e1-2219621e9554 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:07.157030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7f65a871-16c6-49d9-92e1-2219621e9554 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:07.164554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7f65a871-16c6-49d9-92e1-2219621e9554 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.080900 Dec 15 16:39:07.165117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 819/1850] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:07 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:07.764333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-71bc0464-172f-4f36-a890-b07ca839721a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:39:07.765273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-71bc0464-172f-4f36-a890-b07ca839721a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:07.772009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71bc0464-172f-4f36-a890-b07ca839721a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:07.772466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71bc0464-172f-4f36-a890-b07ca839721a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:07.773276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71bc0464-172f-4f36-a890-b07ca839721a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:07.773713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-71bc0464-172f-4f36-a890-b07ca839721a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:07.859381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-71bc0464-172f-4f36-a890-b07ca839721a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action" status: 200 len: 76647 microversion: 2.1 time: 0.098838 Dec 15 16:39:07.860031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1032/1851] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:39:07 2021] POST /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1/action => generated 76647 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:39:08.186606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-97af5673-3b9f-4343-8f52-fdf5f396546f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:08.187188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-97af5673-3b9f-4343-8f52-fdf5f396546f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:08.194261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97af5673-3b9f-4343-8f52-fdf5f396546f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:08.194706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97af5673-3b9f-4343-8f52-fdf5f396546f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:08.195543 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97af5673-3b9f-4343-8f52-fdf5f396546f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:08.195971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-97af5673-3b9f-4343-8f52-fdf5f396546f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:08.265364 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-97af5673-3b9f-4343-8f52-fdf5f396546f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:08.276668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-97af5673-3b9f-4343-8f52-fdf5f396546f tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.093749 Dec 15 16:39:08.277240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 820/1852] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:08 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:09.295041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-059dd11d-d835-4d32-90ae-cdcba152e442 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:09.295684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-059dd11d-d835-4d32-90ae-cdcba152e442 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:09.303032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-059dd11d-d835-4d32-90ae-cdcba152e442 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:09.303481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-059dd11d-d835-4d32-90ae-cdcba152e442 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:09.304271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-059dd11d-d835-4d32-90ae-cdcba152e442 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:09.304741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-059dd11d-d835-4d32-90ae-cdcba152e442 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:09.372464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-059dd11d-d835-4d32-90ae-cdcba152e442 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:09.380728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-059dd11d-d835-4d32-90ae-cdcba152e442 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089737 Dec 15 16:39:09.381168 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1033/1853] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:09 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:09.676899 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f7458891-1086-43c1-90f9-d0841f0517d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:09.677447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f7458891-1086-43c1-90f9-d0841f0517d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:09.684588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7458891-1086-43c1-90f9-d0841f0517d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:09.685018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7458891-1086-43c1-90f9-d0841f0517d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:09.685819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7458891-1086-43c1-90f9-d0841f0517d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:09.686257 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f7458891-1086-43c1-90f9-d0841f0517d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:09.712147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f7458891-1086-43c1-90f9-d0841f0517d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Going to try to terminate instance {{(pid=116022) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:39:09.793727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f7458891-1086-43c1-90f9-d0841f0517d1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "DELETE /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 204 len: 0 microversion: 2.20 time: 0.120130 Dec 15 16:39:09.794628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 821/1854] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Dec 15 16:39:09 2021] DELETE /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:39:09.802813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:09.803509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:09.810451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:09.810908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:09.811707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:09.812207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:09.950498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:09.958991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:09.960466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:09.961595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-306a8f6e-d6bc-47d2-8a2a-0732d0a83be1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.162575 Dec 15 16:39:09.962145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1034/1855] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:10.400262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-daed5756-c59d-4004-91ee-8024d98dd0c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:10.400989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-daed5756-c59d-4004-91ee-8024d98dd0c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:10.407400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-daed5756-c59d-4004-91ee-8024d98dd0c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:10.407841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-daed5756-c59d-4004-91ee-8024d98dd0c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:10.408641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-daed5756-c59d-4004-91ee-8024d98dd0c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:10.409095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-daed5756-c59d-4004-91ee-8024d98dd0c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:10.503645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-daed5756-c59d-4004-91ee-8024d98dd0c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:10.511985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-daed5756-c59d-4004-91ee-8024d98dd0c2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.115597 Dec 15 16:39:10.518884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 822/1856] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:10 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:10.981379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:10.982019 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:10.988829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:10.989280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:10.990068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:10.990500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:11.133702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:11.142718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:11.144195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:11.145374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-03c2e75e-d0a5-47c4-a239-360d0190b3cf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.168129 Dec 15 16:39:11.145927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1035/1857] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:11.529047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-62607461-0736-45ad-910f-00f6607a9ae0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:11.529626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-62607461-0736-45ad-910f-00f6607a9ae0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:11.536384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-62607461-0736-45ad-910f-00f6607a9ae0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:11.536900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-62607461-0736-45ad-910f-00f6607a9ae0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:11.537710 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-62607461-0736-45ad-910f-00f6607a9ae0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:11.538144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-62607461-0736-45ad-910f-00f6607a9ae0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:11.604465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-62607461-0736-45ad-910f-00f6607a9ae0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:11.613355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-62607461-0736-45ad-910f-00f6607a9ae0 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088177 Dec 15 16:39:11.613936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 823/1858] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:11 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:12.165745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:12.166344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:12.173257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:12.173712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:12.174501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:12.175055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:12.309426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:12.318188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:12.319684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:12.320900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5e8fd475-da85-40cf-b989-f79d1ee13acd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.159018 Dec 15 16:39:12.321442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1036/1859] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:12.631915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-801929f4-277b-4722-bbf5-8732f89b283e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:12.632661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-801929f4-277b-4722-bbf5-8732f89b283e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:12.639955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-801929f4-277b-4722-bbf5-8732f89b283e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:12.640456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-801929f4-277b-4722-bbf5-8732f89b283e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:12.641318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-801929f4-277b-4722-bbf5-8732f89b283e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:12.641799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-801929f4-277b-4722-bbf5-8732f89b283e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:12.720860 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-801929f4-277b-4722-bbf5-8732f89b283e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:12.730503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-801929f4-277b-4722-bbf5-8732f89b283e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.102551 Dec 15 16:39:12.731188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 824/1860] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:12 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:13.341119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:13.341852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:13.348456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:13.348920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:13.349709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:13.350148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:13.496987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:13.505566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:13.507045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:13.508191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6d4d486c-e5d2-4be5-93fb-419867e2e021 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171409 Dec 15 16:39:13.508793 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1037/1861] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:13.751690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a81b30c6-a263-4821-a7fc-c2385c19917b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:13.752261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a81b30c6-a263-4821-a7fc-c2385c19917b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:13.758876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a81b30c6-a263-4821-a7fc-c2385c19917b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:13.759328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a81b30c6-a263-4821-a7fc-c2385c19917b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:13.760109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a81b30c6-a263-4821-a7fc-c2385c19917b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:13.760571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a81b30c6-a263-4821-a7fc-c2385c19917b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:13.829874 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a81b30c6-a263-4821-a7fc-c2385c19917b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:13.841843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a81b30c6-a263-4821-a7fc-c2385c19917b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.093787 Dec 15 16:39:13.842727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 825/1862] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:13 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:14.527487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:14.528100 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:14.534696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:14.535157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:14.535941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:14.536363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:14.687447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:14.699480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:14.700981 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:14.702122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-050eab73-6abd-4455-96ff-24163a945a51 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.178646 Dec 15 16:39:14.702677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1038/1863] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:14.863287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2b8fd638-271b-4bc2-9fbd-899d27c63793 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:14.863895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2b8fd638-271b-4bc2-9fbd-899d27c63793 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:14.871261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b8fd638-271b-4bc2-9fbd-899d27c63793 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:14.871714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b8fd638-271b-4bc2-9fbd-899d27c63793 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:14.872541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b8fd638-271b-4bc2-9fbd-899d27c63793 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:14.872981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b8fd638-271b-4bc2-9fbd-899d27c63793 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:14.944410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2b8fd638-271b-4bc2-9fbd-899d27c63793 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:14.953045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2b8fd638-271b-4bc2-9fbd-899d27c63793 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.093576 Dec 15 16:39:14.953622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 826/1864] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:14 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:15.721142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:15.721792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:15.728417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:15.728899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:15.729688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:15.730119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:15.872461 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:15.881359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:15.882843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:15.883992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c0ae3c1f-e57b-4927-bf98-bf001049b4b4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166669 Dec 15 16:39:15.884657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1039/1865] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:15.971549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2af84825-1e17-40c4-acca-be0311c67e8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:15.972149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2af84825-1e17-40c4-acca-be0311c67e8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:15.978854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2af84825-1e17-40c4-acca-be0311c67e8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:15.979296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2af84825-1e17-40c4-acca-be0311c67e8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:15.980197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2af84825-1e17-40c4-acca-be0311c67e8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:15.980668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2af84825-1e17-40c4-acca-be0311c67e8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:16.039767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2af84825-1e17-40c4-acca-be0311c67e8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:16.048008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2af84825-1e17-40c4-acca-be0311c67e8a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.080275 Dec 15 16:39:16.048658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 827/1866] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:15 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:16.905817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:16.906841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:16.915006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:16.915424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:16.916651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:16.917209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:17.065214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:17.067179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4b21bca9-ddc1-4d89-b4ce-55f555d5fb43 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:17.067793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4b21bca9-ddc1-4d89-b4ce-55f555d5fb43 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:17.073915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:17.074980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b21bca9-ddc1-4d89-b4ce-55f555d5fb43 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:17.075397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:17.075528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b21bca9-ddc1-4d89-b4ce-55f555d5fb43 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:17.076223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b21bca9-ddc1-4d89-b4ce-55f555d5fb43 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:17.076572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e520ae05-4cf8-45fa-8e61-cec634b36d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.176523 Dec 15 16:39:17.076685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b21bca9-ddc1-4d89-b4ce-55f555d5fb43 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:17.077341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1040/1867] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:16 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:17.137521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4b21bca9-ddc1-4d89-b4ce-55f555d5fb43 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:17.145706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4b21bca9-ddc1-4d89-b4ce-55f555d5fb43 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.082266 Dec 15 16:39:17.146274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 828/1868] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:17 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:18.097230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:18.098034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:18.107947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:18.108619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:18.109684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:18.110299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:18.164664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f35beee1-b520-4fe8-b07b-a40ef97030b9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:18.165244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f35beee1-b520-4fe8-b07b-a40ef97030b9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:18.172101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f35beee1-b520-4fe8-b07b-a40ef97030b9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:18.172575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f35beee1-b520-4fe8-b07b-a40ef97030b9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:18.173367 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f35beee1-b520-4fe8-b07b-a40ef97030b9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:18.173793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f35beee1-b520-4fe8-b07b-a40ef97030b9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:18.243178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f35beee1-b520-4fe8-b07b-a40ef97030b9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:18.250727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f35beee1-b520-4fe8-b07b-a40ef97030b9 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.089894 Dec 15 16:39:18.251547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 829/1869] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:18 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:18.272412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:18.280934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:18.282398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:18.283541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-46cb7bcd-bdfb-473d-bad0-5fa5e43d82c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.191619 Dec 15 16:39:18.284093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1041/1870] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:19.270548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cd206474-471f-4d5a-b380-2692ab607b52 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:19.271499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cd206474-471f-4d5a-b380-2692ab607b52 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:19.282180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd206474-471f-4d5a-b380-2692ab607b52 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:19.282800 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd206474-471f-4d5a-b380-2692ab607b52 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:19.284021 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd206474-471f-4d5a-b380-2692ab607b52 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:19.284804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd206474-471f-4d5a-b380-2692ab607b52 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:19.302303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:19.303040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:19.310324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:19.310773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:19.311560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:19.312069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:19.351129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cd206474-471f-4d5a-b380-2692ab607b52 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:19.359221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cd206474-471f-4d5a-b380-2692ab607b52 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.093986 Dec 15 16:39:19.359841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 830/1871] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:19 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:19.459622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:19.470482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:19.471951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:19.473142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-391dee00-2e57-4a13-867e-82473af4addd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.174545 Dec 15 16:39:19.473706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1042/1872] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:20.377400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b30273b9-b0b5-4799-8860-bed88e3e390a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:20.378022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b30273b9-b0b5-4799-8860-bed88e3e390a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:20.385193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b30273b9-b0b5-4799-8860-bed88e3e390a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:20.385617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b30273b9-b0b5-4799-8860-bed88e3e390a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:20.386412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b30273b9-b0b5-4799-8860-bed88e3e390a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:20.386840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b30273b9-b0b5-4799-8860-bed88e3e390a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:20.470829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b30273b9-b0b5-4799-8860-bed88e3e390a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:20.482675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b30273b9-b0b5-4799-8860-bed88e3e390a tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.109076 Dec 15 16:39:20.483260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 831/1873] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:20 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:20.491254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:20.491872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:20.501196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:20.501808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:20.502868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:20.503401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:20.648154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:20.656795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:20.658270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:20.659419 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eafea610-4898-434a-b13c-724698050f17 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171942 Dec 15 16:39:20.659968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1043/1874] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:21.500469 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-866dbcdc-4e83-468f-a92c-e84a9c93979e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:21.501136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-866dbcdc-4e83-468f-a92c-e84a9c93979e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:21.516600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-866dbcdc-4e83-468f-a92c-e84a9c93979e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:21.517055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-866dbcdc-4e83-468f-a92c-e84a9c93979e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:21.517854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-866dbcdc-4e83-468f-a92c-e84a9c93979e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:21.518289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-866dbcdc-4e83-468f-a92c-e84a9c93979e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:21.581644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-866dbcdc-4e83-468f-a92c-e84a9c93979e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:21.594275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-866dbcdc-4e83-468f-a92c-e84a9c93979e tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.098670 Dec 15 16:39:21.594844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 832/1875] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:21 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:21.677642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:21.678245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:21.685268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:21.685717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:21.686502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:21.686933 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:21.829111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:21.837360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:21.838827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:21.840756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9ce22b90-edf0-4159-aa64-aea4032b0426 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166173 Dec 15 16:39:21.841165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1044/1876] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:22.615006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ba2b82ac-b7a5-4699-aac8-14a7b1b4de3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:22.615770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ba2b82ac-b7a5-4699-aac8-14a7b1b4de3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:22.624472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba2b82ac-b7a5-4699-aac8-14a7b1b4de3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:22.624908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba2b82ac-b7a5-4699-aac8-14a7b1b4de3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:22.625681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba2b82ac-b7a5-4699-aac8-14a7b1b4de3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:22.626118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba2b82ac-b7a5-4699-aac8-14a7b1b4de3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:22.696917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ba2b82ac-b7a5-4699-aac8-14a7b1b4de3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:22.705330 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ba2b82ac-b7a5-4699-aac8-14a7b1b4de3c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.096582 Dec 15 16:39:22.705934 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 833/1877] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:22 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:22.859625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:22.860240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:22.867109 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:22.867476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:22.868258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:22.868711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:23.250644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:23.259485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:23.261006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:23.262162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5a2bc010-5f59-4e75-a004-378d96264e76 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.406295 Dec 15 16:39:23.262728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1045/1878] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:23.729198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7d8e9104-997c-4679-b7a2-c47fb9933718 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:23.730354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7d8e9104-997c-4679-b7a2-c47fb9933718 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:23.737020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d8e9104-997c-4679-b7a2-c47fb9933718 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:23.737488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d8e9104-997c-4679-b7a2-c47fb9933718 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:23.738296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d8e9104-997c-4679-b7a2-c47fb9933718 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:23.738724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d8e9104-997c-4679-b7a2-c47fb9933718 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:23.799738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7d8e9104-997c-4679-b7a2-c47fb9933718 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:23.807415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7d8e9104-997c-4679-b7a2-c47fb9933718 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.081951 Dec 15 16:39:23.808402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 834/1879] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:23 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:24.283472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:24.284341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:24.293651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:24.294109 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:24.294907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:24.295374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:24.446807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:24.455769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:24.457296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:24.458440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9427c929-efd2-4197-82c5-b9a73b943f8c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180558 Dec 15 16:39:24.459026 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1046/1880] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:24.828614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a0b5256c-2f05-4ce0-a8a8-0d6929f07d98 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:24.829231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a0b5256c-2f05-4ce0-a8a8-0d6929f07d98 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:24.836477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a0b5256c-2f05-4ce0-a8a8-0d6929f07d98 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:24.837005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a0b5256c-2f05-4ce0-a8a8-0d6929f07d98 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:24.837840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a0b5256c-2f05-4ce0-a8a8-0d6929f07d98 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:24.838312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a0b5256c-2f05-4ce0-a8a8-0d6929f07d98 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:24.910723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a0b5256c-2f05-4ce0-a8a8-0d6929f07d98 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:24.919136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a0b5256c-2f05-4ce0-a8a8-0d6929f07d98 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.094663 Dec 15 16:39:24.920031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 835/1881] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:24 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:25.476829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:25.477431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:25.484048 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:25.484540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:25.485322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:25.485753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:25.623619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:25.632588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:25.634057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:25.635206 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a7986594-c72c-4074-bc74-1664c574c20b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.162272 Dec 15 16:39:25.635760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1047/1882] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:25.938950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ed927494-62a8-48a0-ba7c-8b638f949d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:25.939637 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ed927494-62a8-48a0-ba7c-8b638f949d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:25.946450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed927494-62a8-48a0-ba7c-8b638f949d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:25.946857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed927494-62a8-48a0-ba7c-8b638f949d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:25.947669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed927494-62a8-48a0-ba7c-8b638f949d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:25.948093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed927494-62a8-48a0-ba7c-8b638f949d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:26.016908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ed927494-62a8-48a0-ba7c-8b638f949d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:26.028475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ed927494-62a8-48a0-ba7c-8b638f949d00 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.092932 Dec 15 16:39:26.029384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 836/1883] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:25 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:26.663878 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:26.664826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:26.673008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:26.673475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:26.674407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:26.674898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:26.815857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:26.825185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:26.826667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:26.827835 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f8af5469-6ea8-4d75-98b8-ca412c87d937 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171881 Dec 15 16:39:26.828364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1048/1884] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:27.048950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6aedaa6b-d768-48ce-87c4-770d83ecd523 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:27.049792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6aedaa6b-d768-48ce-87c4-770d83ecd523 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:27.059745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6aedaa6b-d768-48ce-87c4-770d83ecd523 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:27.060200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6aedaa6b-d768-48ce-87c4-770d83ecd523 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:27.061080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6aedaa6b-d768-48ce-87c4-770d83ecd523 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:27.061501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6aedaa6b-d768-48ce-87c4-770d83ecd523 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:27.122460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6aedaa6b-d768-48ce-87c4-770d83ecd523 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:27.130573 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6aedaa6b-d768-48ce-87c4-770d83ecd523 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.088098 Dec 15 16:39:27.131142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 837/1885] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:27 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:27.848640 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:27.849463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:27.858823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:27.859489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:27.860767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:27.861451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:28.002296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:28.015101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:28.016614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:28.017798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e6613ca3-8cd7-4bbb-ad2a-778f309619d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.174187 Dec 15 16:39:28.018319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1049/1886] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:28.147515 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2e9f973b-03dc-4662-8dc8-285b62fcf0c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:28.148181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2e9f973b-03dc-4662-8dc8-285b62fcf0c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:28.154937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e9f973b-03dc-4662-8dc8-285b62fcf0c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:28.155378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e9f973b-03dc-4662-8dc8-285b62fcf0c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:28.156143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e9f973b-03dc-4662-8dc8-285b62fcf0c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:28.156766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e9f973b-03dc-4662-8dc8-285b62fcf0c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:28.220342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2e9f973b-03dc-4662-8dc8-285b62fcf0c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:28.229462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2e9f973b-03dc-4662-8dc8-285b62fcf0c8 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.085598 Dec 15 16:39:28.230017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 838/1887] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:28 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:29.038627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:29.039484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:29.049457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:29.050020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:29.051143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:29.051685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:29.208309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:29.219896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:29.221394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:29.222549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f532918c-8808-4432-a439-c65c3cd5d2e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.189478 Dec 15 16:39:29.223155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1050/1888] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:29.254360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-78d77cf5-a91f-46e1-939a-91dfc266fde2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:29.255227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-78d77cf5-a91f-46e1-939a-91dfc266fde2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:29.264995 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78d77cf5-a91f-46e1-939a-91dfc266fde2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:29.265631 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78d77cf5-a91f-46e1-939a-91dfc266fde2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:29.266801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78d77cf5-a91f-46e1-939a-91dfc266fde2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:29.267858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78d77cf5-a91f-46e1-939a-91dfc266fde2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:29.331439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-78d77cf5-a91f-46e1-939a-91dfc266fde2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:29.342487 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-78d77cf5-a91f-46e1-939a-91dfc266fde2 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.094054 Dec 15 16:39:29.343102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 839/1889] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:29 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:30.241404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:30.241992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:30.248614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:30.249058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:30.249841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:30.250275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:30.361080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e513aecd-8f5a-4be9-a263-c195afc57a92 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:30.361697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e513aecd-8f5a-4be9-a263-c195afc57a92 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:30.368185 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e513aecd-8f5a-4be9-a263-c195afc57a92 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:30.368665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e513aecd-8f5a-4be9-a263-c195afc57a92 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:30.369457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e513aecd-8f5a-4be9-a263-c195afc57a92 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:30.369884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e513aecd-8f5a-4be9-a263-c195afc57a92 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:30.395555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:30.404611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:30.406110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:30.407275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8fc82d40-b1e3-4b05-8cdd-a5529888ba2a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.169712 Dec 15 16:39:30.407925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1051/1890] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:30.430181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e513aecd-8f5a-4be9-a263-c195afc57a92 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:30.437958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e513aecd-8f5a-4be9-a263-c195afc57a92 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.081983 Dec 15 16:39:30.438526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 840/1891] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:30 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:39:31.426808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:31.427436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:31.434437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:31.434902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:31.435653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:31.436074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:31.456453 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ae459db3-e7ed-4449-9050-40dca7c6940c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:31.457168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ae459db3-e7ed-4449-9050-40dca7c6940c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:31.463847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae459db3-e7ed-4449-9050-40dca7c6940c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:31.464296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae459db3-e7ed-4449-9050-40dca7c6940c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:31.465127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae459db3-e7ed-4449-9050-40dca7c6940c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:31.466019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae459db3-e7ed-4449-9050-40dca7c6940c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:31.531352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ae459db3-e7ed-4449-9050-40dca7c6940c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:31.539063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ae459db3-e7ed-4449-9050-40dca7c6940c tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.087142 Dec 15 16:39:31.539631 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 841/1892] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:31 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:31.598588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:31.607545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:31.609051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:31.610191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9b0390a9-6294-4403-ac88-baf13a867640 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.187281 Dec 15 16:39:31.610744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1052/1893] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:32.562838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-037fc1e9-aa2f-40cd-adcd-490b17ed8328 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:32.563497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-037fc1e9-aa2f-40cd-adcd-490b17ed8328 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:32.572894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-037fc1e9-aa2f-40cd-adcd-490b17ed8328 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:32.573348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-037fc1e9-aa2f-40cd-adcd-490b17ed8328 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:32.574146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-037fc1e9-aa2f-40cd-adcd-490b17ed8328 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:32.574627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-037fc1e9-aa2f-40cd-adcd-490b17ed8328 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:32.628634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:32.629965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:32.636732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:32.637681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:32.638549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:32.639049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:32.645047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-037fc1e9-aa2f-40cd-adcd-490b17ed8328 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:32.652699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-037fc1e9-aa2f-40cd-adcd-490b17ed8328 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.095503 Dec 15 16:39:32.653372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 842/1894] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:32 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:32.793885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:32.802913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:32.804523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:32.805797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-afd5f263-5f45-4674-a7c7-2d79cd23fd1f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180851 Dec 15 16:39:32.806464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1053/1895] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:39:33.669673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-994b5aa3-0954-4544-9511-7e82519b542b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:33.670389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-994b5aa3-0954-4544-9511-7e82519b542b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:33.677087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-994b5aa3-0954-4544-9511-7e82519b542b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:33.677528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-994b5aa3-0954-4544-9511-7e82519b542b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:33.678338 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-994b5aa3-0954-4544-9511-7e82519b542b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:33.678769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-994b5aa3-0954-4544-9511-7e82519b542b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:33.742175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-994b5aa3-0954-4544-9511-7e82519b542b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:33.750327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-994b5aa3-0954-4544-9511-7e82519b542b tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.084430 Dec 15 16:39:33.750870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 843/1896] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:33 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:33.815475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d83eaaaa-ece7-4329-987f-00ab8a3f9835 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:33.816021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d83eaaaa-ece7-4329-987f-00ab8a3f9835 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:33.823053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d83eaaaa-ece7-4329-987f-00ab8a3f9835 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:33.824130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d83eaaaa-ece7-4329-987f-00ab8a3f9835 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:33.824962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d83eaaaa-ece7-4329-987f-00ab8a3f9835 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:33.825348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:33.825657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d83eaaaa-ece7-4329-987f-00ab8a3f9835 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:33.826278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:33.834105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:33.834536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:33.835604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:33.836218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:33.856047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d83eaaaa-ece7-4329-987f-00ab8a3f9835 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:39:33.948344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d83eaaaa-ece7-4329-987f-00ab8a3f9835 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 204 len: 0 microversion: 2.1 time: 0.135105 Dec 15 16:39:33.949400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1054/1897] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:39:33 2021] DELETE /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:39:33.962656 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9e3cb687-be56-4b5e-b2cf-029164498b5b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:33.963487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9e3cb687-be56-4b5e-b2cf-029164498b5b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:33.971620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e3cb687-be56-4b5e-b2cf-029164498b5b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:33.972346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e3cb687-be56-4b5e-b2cf-029164498b5b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:33.973251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e3cb687-be56-4b5e-b2cf-029164498b5b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:33.973754 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e3cb687-be56-4b5e-b2cf-029164498b5b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:33.991382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:34.001436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:34.010161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:34.011715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5264f345-a9af-4a20-a97f-6e3e8ec9f8fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.190870 Dec 15 16:39:34.012305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 844/1898] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:39:34.108671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9e3cb687-be56-4b5e-b2cf-029164498b5b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:34.115952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9e3cb687-be56-4b5e-b2cf-029164498b5b tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1556 microversion: 2.1 time: 0.159944 Dec 15 16:39:34.116548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1055/1899] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:33 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:34.768061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c5e54d1d-a755-45d4-8431-201c6a61f2fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:34.768781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c5e54d1d-a755-45d4-8431-201c6a61f2fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] [instance: 4c4fd848-09ba-42aa-9176-dc8a60b95be2] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:34.775284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5e54d1d-a755-45d4-8431-201c6a61f2fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:34.775813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5e54d1d-a755-45d4-8431-201c6a61f2fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:34.776735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5e54d1d-a755-45d4-8431-201c6a61f2fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:34.777241 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5e54d1d-a755-45d4-8431-201c6a61f2fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:34.850039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c5e54d1d-a755-45d4-8431-201c6a61f2fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '191079f41ac04162bcb5382c3e872f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8f838e6a4647859457e5560571a5ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:34.859294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c5e54d1d-a755-45d4-8431-201c6a61f2fd tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2" status: 200 len: 1212 microversion: 2.1 time: 0.095767 Dec 15 16:39:34.860162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 845/1900] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:34 2021] GET /compute/v2.1/servers/4c4fd848-09ba-42aa-9176-dc8a60b95be2 => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:35.031115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:35.031872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:35.038300 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:35.038746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:35.039930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:35.040382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:35.085818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-18e645ec-ddf4-4d9e-ba09-b9bf314c9e8e req-a2ad0f24-5019-473e-91a2-368c05de710c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f742b3a2-5ed6-447e-ba04-f3ecae760884", "name": "network-vif-deleted", "tag": "91109cf4-86ff-4b71-9582-363431f8e06c"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:39:35.087614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:39:35.087614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:39:35.101378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-18e645ec-ddf4-4d9e-ba09-b9bf314c9e8e req-a2ad0f24-5019-473e-91a2-368c05de710c service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:35.101378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-18e645ec-ddf4-4d9e-ba09-b9bf314c9e8e req-a2ad0f24-5019-473e-91a2-368c05de710c service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:35.111682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-18e645ec-ddf4-4d9e-ba09-b9bf314c9e8e req-a2ad0f24-5019-473e-91a2-368c05de710c service nova] Creating event network-vif-deleted:91109cf4-86ff-4b71-9582-363431f8e06c for instance f742b3a2-5ed6-447e-ba04-f3ecae760884 on hv-cinder-82002 Dec 15 16:39:35.117550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-18e645ec-ddf4-4d9e-ba09-b9bf314c9e8e req-a2ad0f24-5019-473e-91a2-368c05de710c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111038 Dec 15 16:39:35.118449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1056/1901] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:39:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:39:35.134320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-63c6635e-a35d-4f5a-af6b-d09ee83acce3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] Calling method '.version_select at 0x7f3a7cd41040>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:35.174249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-63c6635e-a35d-4f5a-af6b-d09ee83acce3 tempest-TestShelveInstance-1720366664 tempest-TestShelveInstance-1720366664-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-281409665" status: 202 len: 0 microversion: 2.1 time: 0.042932 Dec 15 16:39:35.175746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1057/1902] 10.222.0.30 () {58 vars in 1250 bytes} [Wed Dec 15 16:39:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-281409665 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:39:35.188576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:35.190202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:35.197232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:35.197886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:35.198852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:35.199422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:35.209572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:35.219747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:35.221560 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:35.222951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2c04dbcc-b715-4dba-9470-657f3749a04a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.196697 Dec 15 16:39:35.224293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 846/1903] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:35.240780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:35.241388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:35.241861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lazy-loading 'fault' on Instance uuid f742b3a2-5ed6-447e-ba04-f3ecae760884 {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:39:35.286590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9227cd2569074a6cbae4066c7650ea9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f522fcfc9fef4de1ba79e2f5a416ecff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:35.294645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b26771ca-2a90-463c-866d-1db4264a7765 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 200 len: 1349 microversion: 2.1 time: 0.116724 Dec 15 16:39:35.295586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1058/1904] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:35 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 1349 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:39:36.242686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:36.243353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:36.251355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:36.251922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:36.253000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:36.253515 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:36.316892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9655a396-df6f-4e1a-a133-faed697a8b54 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:36.317612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9655a396-df6f-4e1a-a133-faed697a8b54 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] [instance: f742b3a2-5ed6-447e-ba04-f3ecae760884] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:36.324878 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9655a396-df6f-4e1a-a133-faed697a8b54 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:36.326325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9655a396-df6f-4e1a-a133-faed697a8b54 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:36.327261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9655a396-df6f-4e1a-a133-faed697a8b54 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:36.327777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9655a396-df6f-4e1a-a133-faed697a8b54 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:36.343853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-9655a396-df6f-4e1a-a133-faed697a8b54 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] HTTP exception thrown: Instance f742b3a2-5ed6-447e-ba04-f3ecae760884 could not be found. Dec 15 16:39:36.344396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9655a396-df6f-4e1a-a133-faed697a8b54 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Returning 404 to user: Instance f742b3a2-5ed6-447e-ba04-f3ecae760884 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:39:36.345259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9655a396-df6f-4e1a-a133-faed697a8b54 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884" status: 404 len: 111 microversion: 2.1 time: 0.032286 Dec 15 16:39:36.345786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1059/1905] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:39:36 2021] GET /compute/v2.1/servers/f742b3a2-5ed6-447e-ba04-f3ecae760884 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:39:36.354276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-439bcc7c-b7c6-463c-87fb-3e49ab06a4e7 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] Calling method '.version_select at 0x7f3a7cc5aee0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:36.378671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-439bcc7c-b7c6-463c-87fb-3e49ab06a4e7 tempest-TestMinimumBasicScenario-548581208 tempest-TestMinimumBasicScenario-548581208-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1408138682" status: 202 len: 0 microversion: 2.1 time: 0.028112 Dec 15 16:39:36.379981 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1060/1906] 10.222.0.30 () {58 vars in 1271 bytes} [Wed Dec 15 16:39:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1408138682 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:39:36.460824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:36.472574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:36.474047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:36.475213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d6e74c6c-4af9-418e-be61-2cc8937021b1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.236455 Dec 15 16:39:36.475774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 847/1907] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:37.494620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:37.495419 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:37.509911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:37.510624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:37.511595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:37.512180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:37.746055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:37.754716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:37.756217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:37.757719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8b8ae58f-ce6b-4633-8bd7-9d49dcf4ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.267776 Dec 15 16:39:37.758316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1061/1908] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:38.777725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:38.780488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:38.791108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:38.791908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:38.793552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:38.794684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:39.348275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:39.357592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:39.359441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:39.365333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9ca23b73-9c56-4453-8491-499e7e3e1a23 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.587430 Dec 15 16:39:39.366540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 848/1909] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:40.390144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:40.391476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:40.398760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:40.399481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:40.400556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:40.401161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:40.689135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:40.707849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:40.710347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:40.711562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ad7dfc78-07c8-43d6-b479-8628c70b8c6b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.326025 Dec 15 16:39:40.712702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1062/1910] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:41.732016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:41.733271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:41.740227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:41.740704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:41.741496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:41.741925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:41.881495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:41.890762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:41.892243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:41.893455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-82b0a50f-7ec1-43bb-bd17-9585b5a4fb62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166359 Dec 15 16:39:41.894030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 849/1911] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:39:42.911255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:42.912572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:42.919016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:42.919458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:42.920312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:42.920765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:43.091055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:43.101114 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:43.102759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:43.104080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-75b1e618-9db7-495c-8ee5-4a95f8097647 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.196547 Dec 15 16:39:43.104751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1063/1912] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:44.126149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:44.129831 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:44.140812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:44.141673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:44.142659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:44.143256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:44.309947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:44.319546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:44.321086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:44.322287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fe7e7f3f-fc40-4ad0-a9a4-54ead6782073 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.200164 Dec 15 16:39:44.324210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 850/1913] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:45.341882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:45.342671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:45.349077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:45.349514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:45.357118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:45.357716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:45.630300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:45.642777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:45.646314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:45.647501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bdcb3ff6-da82-45a9-bd88-28969b308264 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.309888 Dec 15 16:39:45.650913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1064/1914] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:46.666013 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:46.674231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:46.691950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:46.696083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:46.699222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:46.700027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:46.850602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:46.861392 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:46.863012 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:46.864559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-899ec9f4-2556-43d5-892e-dd1291f037bd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.202218 Dec 15 16:39:46.865273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 851/1915] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:47.884178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:47.886209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:47.895506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:47.896407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:47.897470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:47.897961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:48.077165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:48.086916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:48.088590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:48.090079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9dc57e9a-c889-4d6c-8302-3ab452e52d83 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.210164 Dec 15 16:39:48.091209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1065/1916] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:49.109538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:49.110144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:49.117374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:49.117823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:49.118622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:49.119052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:49.263109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:49.275139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:49.277426 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:49.278812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e7b989de-2422-4c3c-b5f0-cfe2aaba45a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.173383 Dec 15 16:39:49.279595 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 852/1917] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:50.298310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:50.298905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:50.306654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:50.307104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:50.307957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:50.308338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:50.458714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:50.468665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:50.470316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:50.471488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-adc1662f-ecec-4956-ae4e-48fb485717a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.177529 Dec 15 16:39:50.472067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1066/1918] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:51.490460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:51.491099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:51.497474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:51.498191 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:51.499388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:51.499977 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:51.745778 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:51.754578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:51.756489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:51.757735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-00805f14-96e6-4ddf-af35-bb7f2c4a13e7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.271355 Dec 15 16:39:51.758813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 853/1919] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:39:52.778142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:52.779285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:52.786509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:52.786963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:52.787769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:52.788203 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:53.080217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:53.094614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:53.100073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:53.105215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cbdb4e85-e5d6-4fcf-b28f-258444fa5f79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.328671 Dec 15 16:39:53.106120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1067/1920] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:54.125069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:54.126584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:54.140082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:54.140846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:54.141844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:54.144456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:54.358231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:54.367876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:54.371218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:54.374849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-24825162-d51e-45e2-b741-2c1d7a6c3da4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.254937 Dec 15 16:39:54.375878 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 854/1921] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:55.394353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:55.395717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:55.402184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:55.402957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:55.404059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:55.404563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:55.545453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:55.554334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:55.555912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:55.557437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-947bcdef-0ce8-40bb-bae1-4df9156fb117 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166783 Dec 15 16:39:55.558066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1068/1922] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:55.594616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-27000470-5f74-44ac-8296-369ebb6a6736 tempest-TestVolumeBootPattern-1047153713 tempest-TestVolumeBootPattern-1047153713-project] Action: 'create', calling method: .version_select at 0x7f3a6f783e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1419449105"}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:39:55.608537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-27000470-5f74-44ac-8296-369ebb6a6736 tempest-TestVolumeBootPattern-1047153713 tempest-TestVolumeBootPattern-1047153713-project] Getting quotas for project d40b3c22c5f248e0849252cbb305cf9e. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:39:55.612331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-27000470-5f74-44ac-8296-369ebb6a6736 tempest-TestVolumeBootPattern-1047153713 tempest-TestVolumeBootPattern-1047153713-project] Getting quotas for user b5e94ec180e040079f14eb44b7f5e6ff and project d40b3c22c5f248e0849252cbb305cf9e. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:39:55.688684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-27000470-5f74-44ac-8296-369ebb6a6736 tempest-TestVolumeBootPattern-1047153713 tempest-TestVolumeBootPattern-1047153713-project] Getting quotas for project d40b3c22c5f248e0849252cbb305cf9e. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:39:55.692576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-27000470-5f74-44ac-8296-369ebb6a6736 tempest-TestVolumeBootPattern-1047153713 tempest-TestVolumeBootPattern-1047153713-project] Getting quotas for user b5e94ec180e040079f14eb44b7f5e6ff and project d40b3c22c5f248e0849252cbb305cf9e. Resources: {'key_pairs'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:39:55.709255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-27000470-5f74-44ac-8296-369ebb6a6736 tempest-TestVolumeBootPattern-1047153713 tempest-TestVolumeBootPattern-1047153713-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.295130 Dec 15 16:39:55.709870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 855/1923] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Dec 15 16:39:55 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:39:56.576958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:56.577559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:56.588229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:56.588622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:56.589429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:56.589866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:56.754386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:56.761031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:56.762494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:56.764006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f7d8c567-92f4-4f8d-aeeb-1665c986aa62 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.191059 Dec 15 16:39:56.765374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1069/1924] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:57.785987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:57.786632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:57.794270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:57.794693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:57.795867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:57.796325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:57.933442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:57.942690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:57.944184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:57.945393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9d971bfb-4b6b-4c8b-bd97-c5889e1172dd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.163717 Dec 15 16:39:57.945964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 856/1925] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:39:58.966641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:39:58.968779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:39:58.982870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:58.983586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:58.984616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:39:58.985205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:39:59.129728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:59.138672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:59.140487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:39:59.141826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f22d4bde-d017-400c-b322-72c72af1b396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.182138 Dec 15 16:39:59.142552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1070/1926] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:39:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:00.160932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:00.161581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:00.167771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:00.168217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:00.169058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:00.169468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:00.305716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:00.315239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:00.316767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:00.317948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-44fa0631-e280-450f-b836-ff7ccd2ede71 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.161063 Dec 15 16:40:00.318528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 857/1927] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:01.336977 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:01.337591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:01.344737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:01.345181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:01.345957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:01.346384 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:01.489405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:01.498590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:01.500066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:01.501313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a6089067-4836-46cb-b4aa-648a7d99ae18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.168076 Dec 15 16:40:01.501860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1071/1928] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:02.522320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:02.522919 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:02.529488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:02.529958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:02.530756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:02.531323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:02.682043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:02.693752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:02.695204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:02.696370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-342fae31-b345-4bd3-ba90-16f44e308d82 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.178122 Dec 15 16:40:02.696969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 858/1929] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:03.718420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:03.719360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:03.726763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:03.727222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:03.728004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:03.728462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:03.861857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:03.871045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:03.872581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:03.873742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e5ec047f-5887-4998-8f52-d8786b6b2a99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.161850 Dec 15 16:40:03.874303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1072/1930] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:04.891376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:04.891932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:04.899600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:04.900053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:04.900885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:04.901331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:05.042766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:05.051534 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:05.053082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:05.054231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-80eeba83-d36a-4cad-befd-03bed3b64d02 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166670 Dec 15 16:40:05.054762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 859/1931] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:06.076799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:06.077448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:06.085127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:06.085574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:06.086358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:06.086793 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:06.224268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:06.232947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:06.234413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:06.235546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a154d2fa-5bd4-40e4-9353-291c3c03ead0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.162785 Dec 15 16:40:06.236097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1073/1932] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:07.257041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:07.257708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:07.265449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:07.266003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:07.266925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:07.267425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:07.403948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:07.413322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:07.414817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:07.415970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2884dd87-a43a-416f-9402-37b15a9535e4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.164023 Dec 15 16:40:07.416526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 860/1933] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:08.438452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:08.439556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:08.451018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:08.451762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:08.453108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:08.453829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:08.594657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:08.608089 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:08.610522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:08.612379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6c4e6c2b-221a-43a5-b973-a16d3f30eb6f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179751 Dec 15 16:40:08.613168 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1074/1934] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:09.635886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:09.636869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:09.648052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:09.648864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:09.650206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:09.650931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:09.791393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:09.803374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:09.804879 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:09.806034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6e73fd2a-797d-4da6-b7ee-ac3d6ba83da6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.176409 Dec 15 16:40:09.806601 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 861/1935] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:10.828022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:10.829036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:10.837199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:10.837638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:10.838412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:10.838842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:11.011605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:11.021033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:11.022566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:11.023759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e942cd06-8a15-4070-8780-35bb6b7fb5ad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.201841 Dec 15 16:40:11.024388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1075/1936] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:12.046295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:12.047169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:12.054938 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:12.055384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:12.056160 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:12.056673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:12.456062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:12.469596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:12.471932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:12.473220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e0d7d826-66d0-44a6-8b20-054cef6294a6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.433570 Dec 15 16:40:12.473779 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 862/1937] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:13.495747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:13.496698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:13.505921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:13.506369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:13.507142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:13.507569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:13.653129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:13.663357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:13.664904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:13.666057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-00fddeb8-d7d7-4ba7-8058-0675c4dd131e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.176912 Dec 15 16:40:13.666615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1076/1938] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:14.688484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:14.689126 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:14.696308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:14.696794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:14.697582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:14.698009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:14.828465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:14.837283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:14.838754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:14.839909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fa15ce93-bd9b-418c-b582-4d83f56f017b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.157551 Dec 15 16:40:14.840851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 863/1939] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:15.865321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:15.866068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:15.874425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:15.874984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:15.875949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:15.876502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:16.013260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:16.023093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:16.024610 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:16.025768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dfcbdb40-36ed-406d-95b4-069375302d1c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166227 Dec 15 16:40:16.026325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1077/1940] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:17.046517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:17.047150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:17.057784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:17.058461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:17.059686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:17.060359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:17.201443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:17.214818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:17.217668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:17.219442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6b6dacf6-24d2-49cb-845a-5b9bd2190591 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.178575 Dec 15 16:40:17.220201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 864/1941] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:18.239526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:18.240115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:18.246841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:18.247290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:18.248066 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:18.248530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:18.383038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:18.391575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:18.393089 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:18.394230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5ac718e6-a861-45db-8bfb-e0605ea285f8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.159152 Dec 15 16:40:18.394777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1078/1942] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:19.416547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:19.417382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:19.428254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:19.429044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:19.430319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:19.431033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:19.577632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:19.586783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:19.588261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:19.589444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6fafb160-5a21-4646-89ef-d57cd060cd80 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179709 Dec 15 16:40:19.590009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 865/1943] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:20.608072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:20.608708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:20.615747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:20.616194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:20.617017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:20.617448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:20.762334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:20.775296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:20.777552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:20.779223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-608211d2-cc8a-4d08-8a2c-39750ae64754 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.174675 Dec 15 16:40:20.779976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1079/1944] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:21.802961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:21.803669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:21.811463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:21.811991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:21.812951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:21.813459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:21.947771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:21.956188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:21.957965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:21.959130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5762e6b8-9d0f-489f-b796-fa30544b79d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.161715 Dec 15 16:40:21.959679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 866/1945] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:22.982544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:22.983715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:22.994408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:22.995155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:22.996472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:22.997242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:23.148560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:23.157412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:23.158875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:23.160146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d452b76e-6ea6-4ef1-9b7e-e0dcb337c3a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.183828 Dec 15 16:40:23.160802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1080/1946] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:24.186533 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:24.187456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:24.198250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:24.198880 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:24.200166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:24.200923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:24.336645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:24.345829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:24.347345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:24.348523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d1345bac-0f44-48a5-a0b7-3315928c3396 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.168203 Dec 15 16:40:24.349099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 867/1947] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:25.371078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:25.372018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:25.381536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:25.381914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:25.382689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:25.383119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:25.519260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:25.528496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:25.530002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:25.531165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8b672f76-141b-4b6e-ae64-c3c78e95cc14 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166325 Dec 15 16:40:25.531731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1081/1948] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:26.552558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:26.553194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:26.560231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:26.560716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:26.561502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:26.562106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:26.716171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:26.725040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:26.726517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:26.727688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6339a605-e767-4397-92e6-647b8596cf3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180787 Dec 15 16:40:26.728243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 868/1949] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:27.750574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:27.751506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:27.762596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:27.763332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:27.764652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:27.765365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:27.905305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:27.919249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:27.921814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:27.923663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0a062a2e-bca4-4de4-9c1b-54fbb561d413 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179127 Dec 15 16:40:27.924570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1082/1950] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:28.946623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:28.947367 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:28.955179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:28.955709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:28.956717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:28.957232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:29.101707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:29.114015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:29.116118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:29.117611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-93fc7ae1-4cfc-4f7b-bcc4-a6fec5cc04c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.176288 Dec 15 16:40:29.118376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 869/1951] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:30.143393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:30.144484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:30.151913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:30.152359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:30.153166 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:30.153599 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:30.295270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:30.304900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:30.306382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:30.307539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-09b5bf9a-0d57-4045-b3bc-16905291080a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.170355 Dec 15 16:40:30.308096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1083/1952] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:31.330074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:31.331028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:31.341837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:31.342574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:31.343846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:31.344709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:31.503666 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:31.516261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:31.518276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:31.520030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a6847fd3-0757-471c-bf12-ebd739e13a88 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.196028 Dec 15 16:40:31.520964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 870/1953] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:32.542628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:32.543533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:32.553187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:32.553637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:32.554416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:32.554846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:32.698660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:32.712302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:32.714655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:32.716897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b1628c87-9615-41ab-8a82-d10a921034c5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179810 Dec 15 16:40:32.717778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1084/1954] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:33.740230 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:33.741152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:33.747857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:33.748308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:33.749115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:33.749549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:33.882869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:33.891643 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:33.893184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:33.894353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-80032f63-18fc-45f8-b14d-a65e129e670f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160301 Dec 15 16:40:33.894894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 871/1955] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:34.916837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:34.917621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:34.926137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:34.926727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:34.927747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:34.928320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:35.066311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:35.075129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:35.076728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:35.077874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8cc18ec0-5ab3-4958-bdc3-833f02523c01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.167270 Dec 15 16:40:35.078439 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1085/1956] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:36.100612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:36.101638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:36.112687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:36.113434 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:36.114741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:36.115564 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:36.256973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:36.265895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:36.267377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:36.268616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-87643d91-9881-454e-8621-e6ca98eaa310 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.174301 Dec 15 16:40:36.269150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 872/1957] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:37.290874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:37.291721 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:37.299893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:37.300489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:37.301452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:37.301988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:37.446223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:37.455275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:37.456820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:37.458002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-85fe2c1f-4b00-4681-adcb-fa90d7b7dc6a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.173386 Dec 15 16:40:37.458560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1086/1958] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:38.481493 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:38.482447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:38.492995 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:38.493470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:38.494251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:38.494681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:38.633983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:38.645070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:38.647362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:38.648946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-53dee65c-3b29-46a1-8740-c959176f8de4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.173989 Dec 15 16:40:38.649784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 873/1959] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:39.677307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:39.678250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:39.685785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:39.686237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:39.687021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:39.687453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:39.825866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:39.834805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:39.836359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:39.837531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-63657f21-2ff8-462b-9704-9aa851bd59df tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166566 Dec 15 16:40:39.838094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1087/1960] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:40.866223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:40.867175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:40.878272 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:40.879019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:40.880366 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:40.881149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:41.018405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:41.031715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:41.034108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:41.036066 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eb4b3e63-ca43-4c78-900d-bf69d25d3220 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175975 Dec 15 16:40:41.036705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 874/1961] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:42.057848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:42.058460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:42.065392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:42.065875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:42.066707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:42.067161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:42.209941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:42.219422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:42.220946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:42.222115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b64fd8ef-08ea-4bf7-8fba-ffe1479fc2b6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.170139 Dec 15 16:40:42.222677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1088/1962] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:43.243909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:43.244629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:43.253564 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:43.254095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:43.255022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:43.255526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:43.403177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:43.415989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:43.417602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:43.418868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-838b4095-df85-4794-913d-839e60c33cf3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179514 Dec 15 16:40:43.419521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 875/1963] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:44.437897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:44.438531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:44.447357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:44.447896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:44.449090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:44.449700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:44.599332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:44.608924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:44.610403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:44.611561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-427dcce7-88cc-4084-a273-b600869e8ec0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.177702 Dec 15 16:40:44.612120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1089/1964] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:45.634287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:45.634981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:45.643928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:45.644903 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:45.646586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:45.647431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:45.812566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:45.821833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:45.823318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:45.824478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-248f72b0-7b6e-4632-a42b-d5a4c38f3cc8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.196708 Dec 15 16:40:45.825078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 876/1965] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:46.845345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:46.846090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:46.854667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:46.855098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:46.855967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:46.856371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:47.002190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:47.011129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:47.012600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:47.013751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-572873b8-16de-4d0e-bccb-fbfdd6fded34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.173917 Dec 15 16:40:47.014307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1090/1966] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:48.040216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:48.040842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:48.050061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:48.050592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:48.051726 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:48.052258 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:48.296886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:48.305204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:48.307549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:48.308752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-37388dbd-ba57-4194-bf0e-7a49193da484 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.273950 Dec 15 16:40:48.309331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 877/1967] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:48 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:49.335080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:49.336005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:49.344209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:49.344701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:49.345487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:49.345926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:49.492841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:49.501670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:49.503156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:49.504314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a51beac0-e66f-4347-9143-49428422de97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175463 Dec 15 16:40:49.504930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1091/1968] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:50.533083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:50.534325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:50.543857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:50.544290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:50.545102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:50.545527 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:50.613017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:40:50.613598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:40:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:40:50.679117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:50.688078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:50.689794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:50.690947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-72586c60-14f7-43f9-b76d-2d1b19179f04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.164217 Dec 15 16:40:50.691532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 878/1969] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:51.713864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:51.714550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:51.722766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:51.723293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:51.724207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:51.724773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:51.873223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:51.882288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:51.883771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:51.885061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dea9b853-d867-441d-be22-1eb1cd5e97f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.177377 Dec 15 16:40:51.885823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1092/1970] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:52.908321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:52.909336 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:52.918911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:52.919358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:52.920368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:52.920913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:53.060124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:53.068841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:53.070320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:53.071480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-45b5a679-b509-4300-a297-6d71dca170b5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.169415 Dec 15 16:40:53.072012 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 879/1971] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:54.094405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:54.095410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:54.106248 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:54.107004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:54.108315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:54.109118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:54.244833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:54.253440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:54.254936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:54.256093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3655c9af-954b-412f-8b08-2381771ad373 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.168507 Dec 15 16:40:54.256760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1093/1972] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:55.279065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:55.280100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:55.291777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:55.292579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:55.293705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:55.294122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:55.440012 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:55.448894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:55.450544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:55.451708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b337ce5d-d0ce-4cd8-9228-70e653a49513 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179622 Dec 15 16:40:55.452244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 880/1973] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:56.474749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:56.475774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:56.484460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:56.484920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:56.485707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:56.486142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:56.622227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:56.631660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:56.633153 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:56.634294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-14cec5bf-796c-4070-99c6-603638cf9461 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165807 Dec 15 16:40:56.634820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1094/1974] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:57.000324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-090dfe05-0218-4c84-8a66-36d107d6577b tempest-TestVolumeBootPattern-1047153713 tempest-TestVolumeBootPattern-1047153713-project] Calling method '.version_select at 0x7f3a6f7835e0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:57.020856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-090dfe05-0218-4c84-8a66-36d107d6577b tempest-TestVolumeBootPattern-1047153713 tempest-TestVolumeBootPattern-1047153713-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1419449105" status: 202 len: 0 microversion: 2.1 time: 0.024019 Dec 15 16:40:57.021297 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 881/1975] 10.222.0.30 () {58 vars in 1262 bytes} [Wed Dec 15 16:40:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1419449105 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:40:57.653336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:57.653944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:57.660681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:57.661134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:57.661940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:57.662379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:57.870316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:57.879174 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:57.880692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:57.881841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-47b5c8a1-5b08-4a83-bd04-c22d4c0771c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.232584 Dec 15 16:40:57.882393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1095/1976] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:40:58.901166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:40:58.901802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:40:58.909025 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:58.909476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:58.910282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:40:58.910725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:40:59.353365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:59.362239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:59.364334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:40:59.366148 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-599e9056-6fe3-4b52-a5a5-af3f9949c272 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.468995 Dec 15 16:40:59.367041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 882/1977] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:40:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:00.385624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:00.386242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:00.393986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:00.394442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:00.395249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:00.395683 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:00.650188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:00.659136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:00.660682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:00.661847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-86163f58-0d45-4c74-a1aa-f0fdf29b6783 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.280004 Dec 15 16:41:00.662423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1096/1978] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:01.680585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:01.681169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:01.687550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:01.687996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:01.688820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:01.689251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:01.930449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:01.940655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:01.942383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:01.943544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-245c6061-6cea-40ca-84dc-333d524bf151 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.267094 Dec 15 16:41:01.944148 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 883/1979] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:02.962296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:02.962962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:02.970119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:02.970557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:02.971335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:02.972038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:03.111631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:03.122945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:03.124367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:03.126567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-73ab9716-cf50-4692-a7dc-14bf6de83789 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.168052 Dec 15 16:41:03.127670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1097/1980] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:04.145237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:04.145848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:04.152137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:04.153190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:04.153987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:04.154424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:04.300670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:04.309511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:04.311043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:04.312211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7491e443-230f-472c-b217-14b84ec11778 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.170880 Dec 15 16:41:04.312812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 884/1981] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:05.330449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:05.331027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:05.337726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:05.338180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:05.338964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:05.339415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:05.474587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:05.483065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:05.484596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:05.485758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ac946e25-aab4-4306-b98d-928c5a1e2bc5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.159192 Dec 15 16:41:05.486333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1098/1982] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:06.507977 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:06.509139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:06.516947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:06.517391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:06.518168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:06.518598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:06.665428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:06.677506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:06.679498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:06.681463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1daed025-8c5f-4022-a141-1568503f7894 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179423 Dec 15 16:41:06.682320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 885/1983] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:07.703737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:07.704718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:07.715325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:07.716500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:07.717750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:07.718461 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:07.853514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:07.872373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:07.873879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:07.875064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7d19f2c5-49a7-4830-a570-46c3d647cc31 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.177610 Dec 15 16:41:07.875691 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1099/1984] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:08.902616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:08.903556 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:08.910293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:08.910736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:08.911509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:08.911941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:09.049392 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:09.057682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:09.059224 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:09.060586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-858d671b-1565-45bd-b68b-0424948f07c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.164291 Dec 15 16:41:09.061151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 886/1985] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:10.079305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:10.080002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:10.086372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:10.086815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:10.087581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:10.088002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:10.220074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:10.228758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:10.230246 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:10.231581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4de95bca-c013-4d7f-a60e-5df15b99db3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.156088 Dec 15 16:41:10.232452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1100/1986] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:11.253876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:11.254498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:11.261061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:11.261505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:11.262276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:11.262704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:11.402145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:11.411371 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:11.412900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:11.414082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-be49ff43-08ec-42df-aeb1-0a2cbbfc4f28 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165600 Dec 15 16:41:11.414795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 887/1987] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:12.437233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:12.438038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:12.447972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:12.448564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:12.449725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:12.450068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:12.601903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:12.610710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:12.612194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:12.613398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a883e196-31bd-4ac0-82b9-dcb1aad12863 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.182388 Dec 15 16:41:12.613963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1101/1988] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:13.631620 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:13.632269 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:13.638959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:13.639401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:13.640178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:13.640640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:13.788872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:13.797313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:13.798785 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:13.799936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-55778c9c-5723-4306-9670-a5c141c2fba1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172073 Dec 15 16:41:13.800483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 888/1989] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:14.818596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:14.819214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:14.825960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:14.826793 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:14.827641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:14.828218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:14.963191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:14.972810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:14.974257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:14.975400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dcb964c6-3b67-4260-ade9-73e43cd2f9d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160611 Dec 15 16:41:14.975963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1102/1990] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:16.002763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:16.003819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:16.014436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:16.014898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:16.015686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:16.016123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:16.079739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:41:16.080021 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:41:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f (ip 10.222.0.30) !!! Dec 15 16:41:16.159443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:16.168948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:16.170412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:16.171673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4097827a-72e2-4f2a-b503-6ffd23dbced7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175345 Dec 15 16:41:16.172245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 889/1991] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:17.191308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:17.193010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:17.200884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:17.201410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:17.202409 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:17.202882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:17.350188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:17.360082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:17.361839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:17.363281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4e012f40-5a49-4ddd-90a1-bd650dab69ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175991 Dec 15 16:41:17.363957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1103/1992] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:18.384553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:18.385188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:18.394059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:18.394560 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:18.395516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:18.396074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:18.541041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:18.549768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:18.551254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:18.552417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1dfada78-a891-4763-afa4-9c0c306ca55e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.173639 Dec 15 16:41:18.553020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 890/1993] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:19.215027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:41:19.215282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:41:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:41:19.571138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:19.571769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:19.578515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:19.578961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:19.579727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:19.580149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:19.721809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:19.735023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:19.737367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:19.738831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bd166fe4-a646-4a67-a1be-a0dd73792b04 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171366 Dec 15 16:41:19.739515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1104/1994] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:20.758156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:20.758775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:20.765589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:20.766037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:20.766821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:20.767253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:20.908081 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:20.916771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:20.918245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:20.919401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-365e0696-a0d5-476f-8f39-8a304147327f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165357 Dec 15 16:41:20.919956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 891/1995] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:21.938443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:21.939121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:21.946581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:21.947082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:21.947945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:21.948460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:22.081116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:22.090276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:22.092157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:22.093344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5171f4a0-2cfa-441b-adf4-57136b568b77 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.159073 Dec 15 16:41:22.093941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1105/1996] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:23.116413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:23.117623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:23.128103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:23.128905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:23.130192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:23.130905 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:23.284040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:23.296075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:23.298351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:23.300073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1ea05130-e3ae-475c-9177-3dc6d9c30978 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.189940 Dec 15 16:41:23.300785 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 892/1997] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:24.319350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:24.319947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:24.326941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:24.327395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:24.328181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:24.328660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:24.464406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:24.473749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:24.475214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:24.476353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-093bd90d-40db-48c6-b184-4a215a213f44 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160880 Dec 15 16:41:24.477069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1106/1998] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:25.497784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:25.498492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:25.506940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:25.507501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:25.508870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:25.509520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:25.918779 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:25.930777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:25.933062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:25.934786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a6a13189-9260-4424-9f45-460714e2b055 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.441944 Dec 15 16:41:25.935473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 893/1999] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:26.960814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:26.962683 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:26.969680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:26.970123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:26.970891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:26.971317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:27.102709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:27.111756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:27.113356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:27.114940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4ace93d9-39fe-4c6b-8fa3-0f919f2aabfd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160319 Dec 15 16:41:27.115776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1107/2000] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:28.136464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:28.137106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:28.144855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:28.145299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:28.146113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:28.146532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:28.283952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:28.293400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:28.294874 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:28.296046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-edee0e39-5fd3-4fa5-b3f7-fcb67574cf39 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.164151 Dec 15 16:41:28.296669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 894/2001] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:29.318607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:29.319599 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:29.330211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:29.330946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:29.332205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:29.332960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:29.470378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:29.482844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:29.485291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:29.487004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-abb252aa-1654-4286-ad6c-1e65495e04fd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.174350 Dec 15 16:41:29.487865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1108/2002] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:30.507814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:30.508783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:30.515338 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:30.515787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:30.516608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:30.517039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:30.652675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:30.661320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:30.662802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:30.663956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a23aa5e3-ef67-4c52-a005-ffebb271702e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160835 Dec 15 16:41:30.664534 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 895/2003] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:31.684301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:31.684961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:31.691592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:31.692037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:31.692847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:31.693274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:31.839227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:31.847864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:31.849360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:31.850502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bb4afe40-375f-4d68-b2cd-72deb9eabacd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.170570 Dec 15 16:41:31.851033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1109/2004] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:32.871295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:32.871933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:32.878590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:32.879037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:32.879808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:32.880236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:33.022406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:33.031562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:33.033098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:33.034271 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-84d4e4d2-1dd9-4015-8186-263179863b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.167658 Dec 15 16:41:33.034847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 896/2005] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:34.055317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:34.056365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:34.065151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:34.065895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:34.067175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:34.067899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:34.212944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b732986a-165b-4cef-88ae-c63e3a81bc7a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:34.214092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b732986a-165b-4cef-88ae-c63e3a81bc7a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:34.220868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b732986a-165b-4cef-88ae-c63e3a81bc7a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:34.221550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b732986a-165b-4cef-88ae-c63e3a81bc7a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:34.222350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b732986a-165b-4cef-88ae-c63e3a81bc7a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:34.222787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b732986a-165b-4cef-88ae-c63e3a81bc7a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:34.256799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b732986a-165b-4cef-88ae-c63e3a81bc7a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Going to try to terminate instance {{(pid=116022) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:41:34.341964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b732986a-165b-4cef-88ae-c63e3a81bc7a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 204 len: 0 microversion: 2.1 time: 0.132792 Dec 15 16:41:34.343311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 897/2006] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:41:34 2021] DELETE /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:41:34.353231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5a01411d-1af4-495e-a08d-31c0ec41a0ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:34.354223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5a01411d-1af4-495e-a08d-31c0ec41a0ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:34.360348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5a01411d-1af4-495e-a08d-31c0ec41a0ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:34.360829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5a01411d-1af4-495e-a08d-31c0ec41a0ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:34.361646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5a01411d-1af4-495e-a08d-31c0ec41a0ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:34.362083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5a01411d-1af4-495e-a08d-31c0ec41a0ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:34.457842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:34.467278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:34.468788 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:34.470014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c12cf8d3-613d-4e98-83c7-03167abe49d8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.419938 Dec 15 16:41:34.470753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1110/2007] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:34.521645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5a01411d-1af4-495e-a08d-31c0ec41a0ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:34.530115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5a01411d-1af4-495e-a08d-31c0ec41a0ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.182361 Dec 15 16:41:34.530692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 898/2008] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:34 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:35.488786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:35.489380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:35.496608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:35.497049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:35.497830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:35.498254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:35.552263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-740891f3-66af-46b2-a3df-a72ebc245263 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:35.552902 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-740891f3-66af-46b2-a3df-a72ebc245263 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:35.560057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-740891f3-66af-46b2-a3df-a72ebc245263 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:35.560538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-740891f3-66af-46b2-a3df-a72ebc245263 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:35.561334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-740891f3-66af-46b2-a3df-a72ebc245263 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:35.561769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-740891f3-66af-46b2-a3df-a72ebc245263 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:35.663603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:35.677604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:35.679140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:35.680300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f86f3bc9-40bd-4e1f-8d98-0d8894f7ac4d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.195597 Dec 15 16:41:35.680890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1111/2009] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:35.728217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-740891f3-66af-46b2-a3df-a72ebc245263 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:35.736655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-740891f3-66af-46b2-a3df-a72ebc245263 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.188126 Dec 15 16:41:35.737226 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 899/2010] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:35 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:36.698871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:36.699499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:36.706078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:36.706631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:36.707405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:36.707830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:36.753575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-84c0f257-b780-4315-9335-894835dee874 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:36.754212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-84c0f257-b780-4315-9335-894835dee874 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:36.760627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84c0f257-b780-4315-9335-894835dee874 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:36.761354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84c0f257-b780-4315-9335-894835dee874 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:36.762141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84c0f257-b780-4315-9335-894835dee874 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:36.762568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84c0f257-b780-4315-9335-894835dee874 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:36.879188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:36.888302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:36.889814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:36.890970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-348ae0ae-7428-4a6b-b17b-4aac934759a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.195970 Dec 15 16:41:36.891503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1112/2011] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:36.923185 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-84c0f257-b780-4315-9335-894835dee874 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:36.931983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-84c0f257-b780-4315-9335-894835dee874 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.182188 Dec 15 16:41:36.932580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 900/2012] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:36 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:41:37.913032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:37.913967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:37.922039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:37.922482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:37.923260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:37.923694 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:37.949273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9f11bc09-737d-40fb-b538-99ff2527eedd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:37.949897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9f11bc09-737d-40fb-b538-99ff2527eedd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:37.957987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f11bc09-737d-40fb-b538-99ff2527eedd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:37.958632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f11bc09-737d-40fb-b538-99ff2527eedd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:37.959532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f11bc09-737d-40fb-b538-99ff2527eedd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:37.960133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9f11bc09-737d-40fb-b538-99ff2527eedd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:38.108920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:38.117511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:38.119012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:38.120303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-50d695b2-4091-4608-b3c4-8596af5cf8d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.213422 Dec 15 16:41:38.121172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1113/2013] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:38.136910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9f11bc09-737d-40fb-b538-99ff2527eedd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:38.145183 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9f11bc09-737d-40fb-b538-99ff2527eedd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.199719 Dec 15 16:41:38.145759 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 901/2014] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:37 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:39.142490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:39.143495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:39.153231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:39.153684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:39.154459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:39.154894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:39.162322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2d9a6c80-51f2-4375-9957-0f66a90324c2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:39.162937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2d9a6c80-51f2-4375-9957-0f66a90324c2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:39.170149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d9a6c80-51f2-4375-9957-0f66a90324c2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:39.170603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d9a6c80-51f2-4375-9957-0f66a90324c2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:39.171377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d9a6c80-51f2-4375-9957-0f66a90324c2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:39.171829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d9a6c80-51f2-4375-9957-0f66a90324c2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:39.345778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:39.349365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2d9a6c80-51f2-4375-9957-0f66a90324c2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:39.354462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:39.356007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:39.357224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f82e75df-737c-41e5-b7bb-32a95c1f580b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.220968 Dec 15 16:41:39.357783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1114/2015] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:39.357948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2d9a6c80-51f2-4375-9957-0f66a90324c2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.199232 Dec 15 16:41:39.358574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 902/2016] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:39 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:40.375430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:40.376148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9151dad7-faed-4d61-89a9-8d761e915ec3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:40.376569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:40.376679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9151dad7-faed-4d61-89a9-8d761e915ec3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:40.382636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:40.382823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9151dad7-faed-4d61-89a9-8d761e915ec3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:40.383082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:40.383261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9151dad7-faed-4d61-89a9-8d761e915ec3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:40.383859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:40.384009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9151dad7-faed-4d61-89a9-8d761e915ec3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:40.384287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:40.384471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9151dad7-faed-4d61-89a9-8d761e915ec3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:40.577513 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9151dad7-faed-4d61-89a9-8d761e915ec3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:40.582058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:40.586810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9151dad7-faed-4d61-89a9-8d761e915ec3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.215205 Dec 15 16:41:40.587469 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1115/2017] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:40 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:40.591241 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:40.592744 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:40.593889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-82d32e61-cb0b-46d4-adb5-ff14e036178a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.222348 Dec 15 16:41:40.594436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 903/2018] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:41.608190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9ab44a63-f801-4425-8f7b-997cd0463a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:41.608988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9ab44a63-f801-4425-8f7b-997cd0463a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:41.613266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:41.614067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:41.617762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ab44a63-f801-4425-8f7b-997cd0463a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:41.618352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ab44a63-f801-4425-8f7b-997cd0463a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:41.619401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ab44a63-f801-4425-8f7b-997cd0463a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:41.619979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ab44a63-f801-4425-8f7b-997cd0463a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:41.622701 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:41.623293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:41.624319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:41.624920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:41.819909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9ab44a63-f801-4425-8f7b-997cd0463a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:41.823813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:41.830806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9ab44a63-f801-4425-8f7b-997cd0463a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.228308 Dec 15 16:41:41.831632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1116/2019] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:41 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:41.835207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:41.836780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:41.837937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6f619e65-70cc-4aa3-9e1d-069a239c126b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.229650 Dec 15 16:41:41.838494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 904/2020] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:42.852795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7c0a439f-6f33-43c0-bb7b-297971aed497 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:42.853669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7c0a439f-6f33-43c0-bb7b-297971aed497 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:42.859229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:42.859875 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:42.862258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c0a439f-6f33-43c0-bb7b-297971aed497 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:42.862802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c0a439f-6f33-43c0-bb7b-297971aed497 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:42.863874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c0a439f-6f33-43c0-bb7b-297971aed497 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:42.864560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7c0a439f-6f33-43c0-bb7b-297971aed497 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:42.868207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:42.868909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:42.869945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:42.870740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:43.062711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7c0a439f-6f33-43c0-bb7b-297971aed497 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:43.066360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:43.071315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7c0a439f-6f33-43c0-bb7b-297971aed497 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.224378 Dec 15 16:41:43.071916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1117/2021] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:42 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:43.075276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:43.076807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:43.077991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4007df35-c9e3-4737-89e4-12a57133683c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.223877 Dec 15 16:41:43.078576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 905/2022] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:44.093304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0ff9fb89-ddbd-4edd-a12f-de46702e7169 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:44.094119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0ff9fb89-ddbd-4edd-a12f-de46702e7169 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:44.098394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:44.099190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:44.102784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ff9fb89-ddbd-4edd-a12f-de46702e7169 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:44.103370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ff9fb89-ddbd-4edd-a12f-de46702e7169 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:44.104482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ff9fb89-ddbd-4edd-a12f-de46702e7169 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:44.105938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ff9fb89-ddbd-4edd-a12f-de46702e7169 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:44.108286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:44.108961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:44.109994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:44.110603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:44.319857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0ff9fb89-ddbd-4edd-a12f-de46702e7169 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:44.324853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:44.332805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0ff9fb89-ddbd-4edd-a12f-de46702e7169 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.245886 Dec 15 16:41:44.333670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1118/2023] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:44 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:44.338109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:44.340268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:44.341839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa023853-11ee-4272-a482-191787e7a74e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.248356 Dec 15 16:41:44.342368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 906/2024] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:45.355647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b910af56-3f27-4d3a-8b11-376b98c05ad6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:45.356229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b910af56-3f27-4d3a-8b11-376b98c05ad6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:45.360016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:45.360632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:45.363061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b910af56-3f27-4d3a-8b11-376b98c05ad6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:45.363526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b910af56-3f27-4d3a-8b11-376b98c05ad6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:45.364309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b910af56-3f27-4d3a-8b11-376b98c05ad6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:45.364765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b910af56-3f27-4d3a-8b11-376b98c05ad6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:45.366694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:45.367140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:45.367932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:45.368353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:45.556962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b910af56-3f27-4d3a-8b11-376b98c05ad6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:45.560748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:45.564934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b910af56-3f27-4d3a-8b11-376b98c05ad6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.215030 Dec 15 16:41:45.565515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1119/2025] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:45 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:45.569764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:45.571263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:45.572460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a8eb42e5-4ec6-42d1-b170-f37539cf6455 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.216291 Dec 15 16:41:45.573018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 907/2026] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:46.583587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-08c9634a-899d-492f-9ccc-2e556095d9df tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:46.584260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-08c9634a-899d-492f-9ccc-2e556095d9df tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:46.592374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:46.592911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-08c9634a-899d-492f-9ccc-2e556095d9df tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:46.592911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-08c9634a-899d-492f-9ccc-2e556095d9df tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:46.593113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:46.593616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-08c9634a-899d-492f-9ccc-2e556095d9df tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:46.594016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-08c9634a-899d-492f-9ccc-2e556095d9df tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:46.599523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:46.599983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:46.600806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:46.601241 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:46.785954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-08c9634a-899d-492f-9ccc-2e556095d9df tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:46.789050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:46.794049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-08c9634a-899d-492f-9ccc-2e556095d9df tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.214784 Dec 15 16:41:46.794761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1120/2027] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:46 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:46.798055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:46.799499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:46.800679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-27cf54b0-2c15-419d-b3d3-91b2efeb02f9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.213172 Dec 15 16:41:46.801292 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 908/2028] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:47.815730 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c872ac2e-44b0-4bb6-be7b-af87c0734830 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:47.816986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c872ac2e-44b0-4bb6-be7b-af87c0734830 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:47.822061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:47.823051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:47.827878 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c872ac2e-44b0-4bb6-be7b-af87c0734830 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:47.828659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c872ac2e-44b0-4bb6-be7b-af87c0734830 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:47.829947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c872ac2e-44b0-4bb6-be7b-af87c0734830 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:47.830658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c872ac2e-44b0-4bb6-be7b-af87c0734830 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:47.833018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:47.833781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:47.835049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:47.835766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:48.028800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c872ac2e-44b0-4bb6-be7b-af87c0734830 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:48.032010 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:48.036858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c872ac2e-44b0-4bb6-be7b-af87c0734830 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.227369 Dec 15 16:41:48.037693 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1121/2029] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:47 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:48.040681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:48.042242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:48.043773 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-25311bad-f167-4f45-a969-5007fc665236 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.227730 Dec 15 16:41:48.044328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 909/2030] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:49.056901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-851f2482-ae84-4a4e-88cd-3b3483057cd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:49.057678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-851f2482-ae84-4a4e-88cd-3b3483057cd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:49.062281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:49.063038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:49.066430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-851f2482-ae84-4a4e-88cd-3b3483057cd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:49.067000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-851f2482-ae84-4a4e-88cd-3b3483057cd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:49.067978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-851f2482-ae84-4a4e-88cd-3b3483057cd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:49.068559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-851f2482-ae84-4a4e-88cd-3b3483057cd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:49.070643 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:49.071334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:49.072345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:49.072930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:49.261557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-851f2482-ae84-4a4e-88cd-3b3483057cd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:49.265071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:49.269606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-851f2482-ae84-4a4e-88cd-3b3483057cd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.218112 Dec 15 16:41:49.270196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1122/2031] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:49 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:49.273639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:49.275236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:49.276650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a39a2438-bb1c-4824-9d1d-55978f2cae64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.218796 Dec 15 16:41:49.277373 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 910/2032] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:50.290401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-daecd41e-477a-40c3-9f2c-a89b78353bd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:50.290939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-daecd41e-477a-40c3-9f2c-a89b78353bd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:50.298355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daecd41e-477a-40c3-9f2c-a89b78353bd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:50.298796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daecd41e-477a-40c3-9f2c-a89b78353bd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:50.299536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:50.299990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daecd41e-477a-40c3-9f2c-a89b78353bd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:50.299990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daecd41e-477a-40c3-9f2c-a89b78353bd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:50.300184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:50.306402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:50.306846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:50.307622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:50.308368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:50.504039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-daecd41e-477a-40c3-9f2c-a89b78353bd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:50.507546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:50.512829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-daecd41e-477a-40c3-9f2c-a89b78353bd0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.228359 Dec 15 16:41:50.513395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1123/2033] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:50 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:50.516536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:50.518099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:50.519274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e1f7b279-d472-4745-81fc-878e7fb2487f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.223493 Dec 15 16:41:50.519830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 911/2034] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:51.530382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b33210d9-b9e3-4de0-819e-aa5cea92baa1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:51.531027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b33210d9-b9e3-4de0-819e-aa5cea92baa1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:51.537617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:51.538097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b33210d9-b9e3-4de0-819e-aa5cea92baa1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:51.538097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b33210d9-b9e3-4de0-819e-aa5cea92baa1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:51.538305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:51.538897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b33210d9-b9e3-4de0-819e-aa5cea92baa1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:51.539332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b33210d9-b9e3-4de0-819e-aa5cea92baa1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:51.545159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:51.545610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:51.546399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:51.546832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:51.734956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b33210d9-b9e3-4de0-819e-aa5cea92baa1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:51.738359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:51.743375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b33210d9-b9e3-4de0-819e-aa5cea92baa1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.216836 Dec 15 16:41:51.743965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1124/2035] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:51 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:51.747531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:51.749090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:51.750293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-64141b6d-8f2b-4bb2-bd6d-6ac44321d16c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.216513 Dec 15 16:41:51.750884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 912/2036] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:52.764201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d4868f40-336e-4354-a588-8f52d0519395 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:52.765018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d4868f40-336e-4354-a588-8f52d0519395 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:52.770663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:52.771470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:52.773947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4868f40-336e-4354-a588-8f52d0519395 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:52.774543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4868f40-336e-4354-a588-8f52d0519395 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:52.775577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4868f40-336e-4354-a588-8f52d0519395 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:52.776155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4868f40-336e-4354-a588-8f52d0519395 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:52.780113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:52.781023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:52.782068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:52.782660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:52.982169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d4868f40-336e-4354-a588-8f52d0519395 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:52.985750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:52.990093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d4868f40-336e-4354-a588-8f52d0519395 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.231944 Dec 15 16:41:52.990641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1125/2037] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:52 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:41:52.994198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:52.995684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:52.996926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-08c51b07-8005-4d19-b51b-74c3d5826ea4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.231234 Dec 15 16:41:52.997474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 913/2038] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:54.010915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-27e9a472-d63a-404e-babc-88784ab9eb23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:54.011638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-27e9a472-d63a-404e-babc-88784ab9eb23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:54.020699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:54.021712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:54.022616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27e9a472-d63a-404e-babc-88784ab9eb23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:54.023356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27e9a472-d63a-404e-babc-88784ab9eb23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:54.024716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27e9a472-d63a-404e-babc-88784ab9eb23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:54.025430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27e9a472-d63a-404e-babc-88784ab9eb23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:54.030883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:54.031321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:54.032118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:54.032585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:54.225501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-27e9a472-d63a-404e-babc-88784ab9eb23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:54.228600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:54.234002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-27e9a472-d63a-404e-babc-88784ab9eb23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.229355 Dec 15 16:41:54.234545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1126/2039] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:54 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:54.238105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:54.239587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:54.240918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d4b4a0c8-527a-4695-b85a-9e6b81226715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.227200 Dec 15 16:41:54.241478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 914/2040] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:55.254981 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d295df0b-2810-4291-8a51-a7badc85a60b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:55.255981 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d295df0b-2810-4291-8a51-a7badc85a60b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:55.262638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:55.263245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:55.265071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d295df0b-2810-4291-8a51-a7badc85a60b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:55.265516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d295df0b-2810-4291-8a51-a7badc85a60b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:55.266298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d295df0b-2810-4291-8a51-a7badc85a60b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:55.266728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d295df0b-2810-4291-8a51-a7badc85a60b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:55.269943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:55.271665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:55.272303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:55.272788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:55.461280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d295df0b-2810-4291-8a51-a7badc85a60b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:55.464390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:55.471051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d295df0b-2810-4291-8a51-a7badc85a60b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.222131 Dec 15 16:41:55.478019 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1127/2041] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:55 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:55.478199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:55.478199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:55.478199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-59e538ed-37bd-4f84-9a06-655210b3cf7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.221000 Dec 15 16:41:55.478505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 915/2042] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:56.493043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2098151f-661d-43ee-9eed-3c3898b52564 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:56.494277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2098151f-661d-43ee-9eed-3c3898b52564 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:56.499308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:56.500316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:56.506345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2098151f-661d-43ee-9eed-3c3898b52564 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:56.507097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2098151f-661d-43ee-9eed-3c3898b52564 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:56.508402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2098151f-661d-43ee-9eed-3c3898b52564 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:56.509220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2098151f-661d-43ee-9eed-3c3898b52564 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:56.510109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:56.510843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:56.512267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:56.512748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:56.704915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:56.707976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2098151f-661d-43ee-9eed-3c3898b52564 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:56.713667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:56.715250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:56.716577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2098151f-661d-43ee-9eed-3c3898b52564 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.229184 Dec 15 16:41:56.716806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e39d7760-0320-43ae-acfd-a3efd9995d40 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.224291 Dec 15 16:41:56.717156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1128/2043] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:56 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:56.717722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 916/2044] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:57.738109 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ccfcbe86-8d05-43ff-8777-d3a302016047 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:57.739080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:57.739706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ccfcbe86-8d05-43ff-8777-d3a302016047 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:57.739889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:57.748702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ccfcbe86-8d05-43ff-8777-d3a302016047 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:57.749149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ccfcbe86-8d05-43ff-8777-d3a302016047 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:57.749320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:57.749806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:57.749976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ccfcbe86-8d05-43ff-8777-d3a302016047 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:57.750338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ccfcbe86-8d05-43ff-8777-d3a302016047 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:57.750586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:57.751036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:57.952902 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:57.957236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ccfcbe86-8d05-43ff-8777-d3a302016047 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:57.961547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:57.963048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:57.964215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-77da1079-4bfd-4ee6-a220-5e5ac8ec86a0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.231471 Dec 15 16:41:57.964811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 917/2045] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:41:57.965163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ccfcbe86-8d05-43ff-8777-d3a302016047 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.233170 Dec 15 16:41:57.965762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1129/2046] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:57 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:58.983287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2c22301d-1b01-45ec-bd37-fafa7276eb61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:58.983938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:41:58.984344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2c22301d-1b01-45ec-bd37-fafa7276eb61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:58.984487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:41:58.990614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:58.990795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c22301d-1b01-45ec-bd37-fafa7276eb61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:58.991062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:58.991192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c22301d-1b01-45ec-bd37-fafa7276eb61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:58.991834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:58.991954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c22301d-1b01-45ec-bd37-fafa7276eb61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:41:58.992259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:58.992386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2c22301d-1b01-45ec-bd37-fafa7276eb61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:41:59.183998 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2c22301d-1b01-45ec-bd37-fafa7276eb61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:59.187669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:59.193006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2c22301d-1b01-45ec-bd37-fafa7276eb61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.213868 Dec 15 16:41:59.193580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 918/2047] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:41:58 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:41:59.196059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:59.197558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:41:59.198713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-02cfde24-dd7b-455d-a650-df7af799cb01 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.219033 Dec 15 16:41:59.199270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1130/2048] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:41:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:00.214313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8223608c-41a6-433c-a13d-bf91b7904188 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:00.215394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8223608c-41a6-433c-a13d-bf91b7904188 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:00.226129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:00.226874 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8223608c-41a6-433c-a13d-bf91b7904188 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:00.227076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8223608c-41a6-433c-a13d-bf91b7904188 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:00.227441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:00.228394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8223608c-41a6-433c-a13d-bf91b7904188 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:00.229172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8223608c-41a6-433c-a13d-bf91b7904188 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:00.236177 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:00.236677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:00.237466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:00.237934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:00.423775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8223608c-41a6-433c-a13d-bf91b7904188 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:00.426927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:00.432196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8223608c-41a6-433c-a13d-bf91b7904188 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.224339 Dec 15 16:42:00.432881 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 919/2049] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:00 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:00.435191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:00.436716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:00.437881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3befe491-33a8-42f7-9c40-34d8d862f8ee tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.217911 Dec 15 16:42:00.438404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1131/2050] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:01.454685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8f13b16f-7f4b-47ce-a33a-95766ad7dcfa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:01.455554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8f13b16f-7f4b-47ce-a33a-95766ad7dcfa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:01.459470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:01.460424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:01.466761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f13b16f-7f4b-47ce-a33a-95766ad7dcfa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:01.467203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f13b16f-7f4b-47ce-a33a-95766ad7dcfa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:01.467989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f13b16f-7f4b-47ce-a33a-95766ad7dcfa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:01.468420 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8f13b16f-7f4b-47ce-a33a-95766ad7dcfa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:01.469818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:01.470269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:01.471039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:01.471462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:01.658305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8f13b16f-7f4b-47ce-a33a-95766ad7dcfa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:01.662891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:01.666833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8f13b16f-7f4b-47ce-a33a-95766ad7dcfa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.218643 Dec 15 16:42:01.667626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 920/2051] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:01 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:01.672467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:01.673971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:01.675131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4770fd04-3b6f-423d-98cc-7e61066c59b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.221665 Dec 15 16:42:01.675881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1132/2052] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:02.689975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-673dda28-dfb4-464c-96e0-3af8c37bdb74 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:02.690933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-673dda28-dfb4-464c-96e0-3af8c37bdb74 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:02.696781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:02.697762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:02.701762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-673dda28-dfb4-464c-96e0-3af8c37bdb74 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:02.702207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-673dda28-dfb4-464c-96e0-3af8c37bdb74 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:02.703034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-673dda28-dfb4-464c-96e0-3af8c37bdb74 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:02.703468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-673dda28-dfb4-464c-96e0-3af8c37bdb74 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:02.705866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:02.706310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:02.707089 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:02.707518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:02.905412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-673dda28-dfb4-464c-96e0-3af8c37bdb74 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:02.909547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:02.913596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-673dda28-dfb4-464c-96e0-3af8c37bdb74 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.230328 Dec 15 16:42:02.914184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 921/2053] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:02 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:02.917903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:02.919383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:02.921209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-24297fe3-1fe4-4518-8743-446f0ddcd0d3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.230571 Dec 15 16:42:02.921759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1133/2054] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:42:03.934714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a48dde6b-bc7d-4186-b520-6a8a10aa9a89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:03.935742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a48dde6b-bc7d-4186-b520-6a8a10aa9a89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:03.945202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:03.946211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:03.946661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a48dde6b-bc7d-4186-b520-6a8a10aa9a89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:03.947468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a48dde6b-bc7d-4186-b520-6a8a10aa9a89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:03.948810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a48dde6b-bc7d-4186-b520-6a8a10aa9a89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:03.949522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a48dde6b-bc7d-4186-b520-6a8a10aa9a89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:03.954817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:03.955272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:03.956044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:03.956473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:04.154384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a48dde6b-bc7d-4186-b520-6a8a10aa9a89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:04.157783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:04.163056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a48dde6b-bc7d-4186-b520-6a8a10aa9a89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.235107 Dec 15 16:42:04.163645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 922/2055] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:03 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:04.166056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:04.167597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:04.168770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e1b08529-b433-495f-835d-883a81300dcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.229820 Dec 15 16:42:04.169310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1134/2056] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:05.184493 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-637e949d-ca8d-4fe1-b5b6-9c0542c1a385 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:05.185622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-637e949d-ca8d-4fe1-b5b6-9c0542c1a385 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:05.189396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:05.189999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:05.192299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-637e949d-ca8d-4fe1-b5b6-9c0542c1a385 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:05.192777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-637e949d-ca8d-4fe1-b5b6-9c0542c1a385 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:05.193560 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-637e949d-ca8d-4fe1-b5b6-9c0542c1a385 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:05.193986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-637e949d-ca8d-4fe1-b5b6-9c0542c1a385 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:05.196594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:05.197047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:05.197818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:05.198253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:05.381617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:05.388495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-637e949d-ca8d-4fe1-b5b6-9c0542c1a385 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:05.391000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:05.392481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:05.393656 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-751e5dbb-b7fe-492c-adf6-6cd0b4c125ae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.209245 Dec 15 16:42:05.394460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1135/2057] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:05.396884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-637e949d-ca8d-4fe1-b5b6-9c0542c1a385 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.218759 Dec 15 16:42:05.397444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 923/2058] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:05 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:06.416886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:06.417839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-50e297ee-99a8-4808-be8d-263882e65c46 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:06.418466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:06.418890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-50e297ee-99a8-4808-be8d-263882e65c46 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:06.425945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:06.426212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50e297ee-99a8-4808-be8d-263882e65c46 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:06.426367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:06.426669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50e297ee-99a8-4808-be8d-263882e65c46 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:06.427197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:06.427467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50e297ee-99a8-4808-be8d-263882e65c46 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:06.427706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:06.427907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50e297ee-99a8-4808-be8d-263882e65c46 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:06.617985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:06.625160 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-50e297ee-99a8-4808-be8d-263882e65c46 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:06.627060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:06.628611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:06.629758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-750d81c8-4f29-4fe2-83e9-37ccc44985a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.219275 Dec 15 16:42:06.630312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1136/2059] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:06.633077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-50e297ee-99a8-4808-be8d-263882e65c46 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.221321 Dec 15 16:42:06.633646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 924/2060] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:06 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:07.652349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:07.653323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:07.653937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a605bcfb-5ef4-4a58-95f4-dcdf143192a5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:07.655151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a605bcfb-5ef4-4a58-95f4-dcdf143192a5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:07.664249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:07.664832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a605bcfb-5ef4-4a58-95f4-dcdf143192a5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:07.665123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:07.665610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a605bcfb-5ef4-4a58-95f4-dcdf143192a5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:07.666299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:07.666891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a605bcfb-5ef4-4a58-95f4-dcdf143192a5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:07.667123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:07.667580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a605bcfb-5ef4-4a58-95f4-dcdf143192a5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:07.860206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a605bcfb-5ef4-4a58-95f4-dcdf143192a5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:07.863271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:07.868314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a605bcfb-5ef4-4a58-95f4-dcdf143192a5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.220467 Dec 15 16:42:07.868897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 925/2061] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:07 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:07.871671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:07.873180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:07.874321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3e6ef521-860e-4e91-aadd-f89e49471cad tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.228350 Dec 15 16:42:07.874863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1137/2062] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:08.890959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-475cb12d-c6b0-4bd6-823c-edc503e91796 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:08.891986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-475cb12d-c6b0-4bd6-823c-edc503e91796 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:08.902615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-475cb12d-c6b0-4bd6-823c-edc503e91796 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:08.903358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-475cb12d-c6b0-4bd6-823c-edc503e91796 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:08.904940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-475cb12d-c6b0-4bd6-823c-edc503e91796 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:08.905119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-475cb12d-c6b0-4bd6-823c-edc503e91796 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:09.011011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:09.011619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:09.017745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:09.018189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:09.018972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:09.019384 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:09.039985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-475cb12d-c6b0-4bd6-823c-edc503e91796 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:09.047980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-475cb12d-c6b0-4bd6-823c-edc503e91796 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163309 Dec 15 16:42:09.048788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 926/2063] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:08 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:09.156047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:09.164781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:09.166249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:09.167388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fae02d43-8b60-4515-b113-ab1f2fe673c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.272405 Dec 15 16:42:09.167945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1138/2064] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:10.068928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-652c54d4-bceb-4d46-a3bb-5fe4d13fb843 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:10.069861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-652c54d4-bceb-4d46-a3bb-5fe4d13fb843 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:10.079022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-652c54d4-bceb-4d46-a3bb-5fe4d13fb843 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:10.079467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-652c54d4-bceb-4d46-a3bb-5fe4d13fb843 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:10.080245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-652c54d4-bceb-4d46-a3bb-5fe4d13fb843 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:10.080705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-652c54d4-bceb-4d46-a3bb-5fe4d13fb843 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:10.186080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:10.186679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:10.193150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:10.193602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:10.194375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:10.194802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:10.215288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-652c54d4-bceb-4d46-a3bb-5fe4d13fb843 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:10.224201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-652c54d4-bceb-4d46-a3bb-5fe4d13fb843 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.162157 Dec 15 16:42:10.224824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 927/2065] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:10 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:10.328267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:10.337267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:10.338733 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:10.339880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6976ca4a-aaf1-4cf7-9614-9bf046a3803f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.157732 Dec 15 16:42:10.340408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1139/2066] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:11.245018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3a7a6258-7ed6-4fd5-9d77-f6d8a8116944 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:11.246051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3a7a6258-7ed6-4fd5-9d77-f6d8a8116944 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:11.254639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a7a6258-7ed6-4fd5-9d77-f6d8a8116944 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:11.255069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a7a6258-7ed6-4fd5-9d77-f6d8a8116944 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:11.255858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a7a6258-7ed6-4fd5-9d77-f6d8a8116944 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:11.256294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a7a6258-7ed6-4fd5-9d77-f6d8a8116944 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:11.359653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:11.360851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:11.367558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:11.368002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:11.368816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:11.369244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:11.405466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3a7a6258-7ed6-4fd5-9d77-f6d8a8116944 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:11.413597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3a7a6258-7ed6-4fd5-9d77-f6d8a8116944 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.174847 Dec 15 16:42:11.414189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 928/2067] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:11 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:11.501356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:11.510322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:11.511809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:11.513003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a290030a-bbf6-4a07-a129-55de30117d5e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.157185 Dec 15 16:42:11.513560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1140/2068] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:12.433754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-afc5a58b-a1d5-40be-b3ed-3c608adb0ca4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:12.434549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-afc5a58b-a1d5-40be-b3ed-3c608adb0ca4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:12.442189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afc5a58b-a1d5-40be-b3ed-3c608adb0ca4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:12.442634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afc5a58b-a1d5-40be-b3ed-3c608adb0ca4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:12.443409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afc5a58b-a1d5-40be-b3ed-3c608adb0ca4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:12.443838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afc5a58b-a1d5-40be-b3ed-3c608adb0ca4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:12.531865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:12.532474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:12.539147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:12.539589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:12.540375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:12.540861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:12.588681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-afc5a58b-a1d5-40be-b3ed-3c608adb0ca4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:12.597404 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-afc5a58b-a1d5-40be-b3ed-3c608adb0ca4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169674 Dec 15 16:42:12.597989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 929/2069] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:12 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:12.676006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:12.685218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:12.686618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:12.687766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-377a12e5-ba4a-4955-83be-1a07eacffcba tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.159815 Dec 15 16:42:12.688744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1141/2070] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:13.616037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4bd14424-3f73-422f-8b68-8e1fbf1808fd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:13.616841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4bd14424-3f73-422f-8b68-8e1fbf1808fd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:13.623815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4bd14424-3f73-422f-8b68-8e1fbf1808fd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:13.624296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4bd14424-3f73-422f-8b68-8e1fbf1808fd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:13.625211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4bd14424-3f73-422f-8b68-8e1fbf1808fd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:13.625664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4bd14424-3f73-422f-8b68-8e1fbf1808fd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:13.706994 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:13.707595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:13.714422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:13.714875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:13.715655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:13.716467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:13.794170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4bd14424-3f73-422f-8b68-8e1fbf1808fd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:13.802418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4bd14424-3f73-422f-8b68-8e1fbf1808fd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.190950 Dec 15 16:42:13.803006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 930/2071] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:13 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:13.861586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:13.873111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:13.875477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:13.877197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9815d7b4-83f6-476b-9f06-4c9c9e9cbc26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.173909 Dec 15 16:42:13.878020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1142/2072] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:14.822924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-45aeeb6a-d4e5-4342-a833-419295cd4975 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:14.823927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-45aeeb6a-d4e5-4342-a833-419295cd4975 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:14.835289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45aeeb6a-d4e5-4342-a833-419295cd4975 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:14.836034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45aeeb6a-d4e5-4342-a833-419295cd4975 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:14.837413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45aeeb6a-d4e5-4342-a833-419295cd4975 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:14.838133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45aeeb6a-d4e5-4342-a833-419295cd4975 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:14.896368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:14.897009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:14.904260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:14.904797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:14.905622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:14.906077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:15.006897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-45aeeb6a-d4e5-4342-a833-419295cd4975 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:15.015133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-45aeeb6a-d4e5-4342-a833-419295cd4975 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.198385 Dec 15 16:42:15.015724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 931/2073] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:14 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:15.071824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:15.081140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:15.082551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:15.083678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-93ced27e-a3e4-40a3-8234-5044730eb96b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.192321 Dec 15 16:42:15.084235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1143/2074] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:16.033167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e29901a7-9d60-4e0c-af8e-a868cc52bced tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:16.033837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e29901a7-9d60-4e0c-af8e-a868cc52bced tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:16.041339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e29901a7-9d60-4e0c-af8e-a868cc52bced tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:16.041842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e29901a7-9d60-4e0c-af8e-a868cc52bced tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:16.042713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e29901a7-9d60-4e0c-af8e-a868cc52bced tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:16.043202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e29901a7-9d60-4e0c-af8e-a868cc52bced tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:16.103123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:16.103729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:16.110840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:16.111279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:16.112034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:16.112488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:16.206504 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e29901a7-9d60-4e0c-af8e-a868cc52bced tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:16.215041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e29901a7-9d60-4e0c-af8e-a868cc52bced tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.186010 Dec 15 16:42:16.215626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 932/2075] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:16 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:16.522325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:16.534471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:16.535946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:16.537134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-97f70eed-b7cc-42fb-ae7c-56505119c33d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.437773 Dec 15 16:42:16.537686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1144/2076] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:16 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:17.231885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0bb16bcc-0ece-46a8-a0b2-c1bd7cb3481b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:17.232557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0bb16bcc-0ece-46a8-a0b2-c1bd7cb3481b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:17.239473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0bb16bcc-0ece-46a8-a0b2-c1bd7cb3481b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:17.239955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0bb16bcc-0ece-46a8-a0b2-c1bd7cb3481b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:17.240751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0bb16bcc-0ece-46a8-a0b2-c1bd7cb3481b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:17.241179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0bb16bcc-0ece-46a8-a0b2-c1bd7cb3481b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:17.372930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0bb16bcc-0ece-46a8-a0b2-c1bd7cb3481b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:17.382418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0bb16bcc-0ece-46a8-a0b2-c1bd7cb3481b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.154190 Dec 15 16:42:17.382894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 933/2077] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:17 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:17.559084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:17.560012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:17.568215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:17.568697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:17.569465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:17.569893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:17.714926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:17.725368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:17.726834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:17.727991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-061fea44-cf6a-4344-b29e-5824e5af43a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175335 Dec 15 16:42:17.728571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1145/2078] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:18.403476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-be685d3a-39f9-4584-a36b-87c99da36df8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:18.404164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-be685d3a-39f9-4584-a36b-87c99da36df8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:18.411755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be685d3a-39f9-4584-a36b-87c99da36df8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:18.412204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be685d3a-39f9-4584-a36b-87c99da36df8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:18.413031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be685d3a-39f9-4584-a36b-87c99da36df8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:18.413459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be685d3a-39f9-4584-a36b-87c99da36df8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:18.553806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-be685d3a-39f9-4584-a36b-87c99da36df8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:18.562056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-be685d3a-39f9-4584-a36b-87c99da36df8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164561 Dec 15 16:42:18.562607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 934/2079] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:18 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:18.750476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:18.751425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:18.762404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:18.763144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:18.764491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:18.765197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:18.902873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:18.912060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:18.913587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:18.914739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4aa4fe3b-ad0b-4e82-9580-f2fdaf4b49d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.170612 Dec 15 16:42:18.915277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1146/2080] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:19.582474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-899acdde-3318-4716-ba2e-24a3ed1d88b9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:19.583181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-899acdde-3318-4716-ba2e-24a3ed1d88b9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:19.591790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-899acdde-3318-4716-ba2e-24a3ed1d88b9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:19.592344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-899acdde-3318-4716-ba2e-24a3ed1d88b9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:19.593369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-899acdde-3318-4716-ba2e-24a3ed1d88b9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:19.593915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-899acdde-3318-4716-ba2e-24a3ed1d88b9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:19.746698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-899acdde-3318-4716-ba2e-24a3ed1d88b9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:19.755163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-899acdde-3318-4716-ba2e-24a3ed1d88b9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.178326 Dec 15 16:42:19.755740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 935/2081] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:19 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:19.936568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:19.937420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:19.945028 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:19.945466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:19.946246 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:19.946675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:20.091739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:20.100528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:20.102001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:20.103147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c55a7e2d-e210-43ee-8f01-8c659265b943 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172860 Dec 15 16:42:20.103713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1147/2082] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:20.776235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-70c027d2-297f-4672-87bf-3125541a6642 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:20.777229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-70c027d2-297f-4672-87bf-3125541a6642 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:20.787911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70c027d2-297f-4672-87bf-3125541a6642 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:20.788737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70c027d2-297f-4672-87bf-3125541a6642 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:20.790029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70c027d2-297f-4672-87bf-3125541a6642 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:20.790757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70c027d2-297f-4672-87bf-3125541a6642 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:20.940843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-70c027d2-297f-4672-87bf-3125541a6642 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:20.948897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-70c027d2-297f-4672-87bf-3125541a6642 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.178831 Dec 15 16:42:20.949463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 936/2083] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:20 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:21.123550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:21.124273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:21.131658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:21.132103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:21.132912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:21.133340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:21.266948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:21.280663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:21.283031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:21.284352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-38b5b574-8243-456a-8aff-0a85741c5a57 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165506 Dec 15 16:42:21.284940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1148/2084] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:21.968959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-475ed325-9501-4190-8e47-e0d35881f7c5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:21.969553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-475ed325-9501-4190-8e47-e0d35881f7c5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:21.978451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-475ed325-9501-4190-8e47-e0d35881f7c5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:21.978893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-475ed325-9501-4190-8e47-e0d35881f7c5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:21.979671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-475ed325-9501-4190-8e47-e0d35881f7c5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:21.980095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-475ed325-9501-4190-8e47-e0d35881f7c5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:22.136119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-475ed325-9501-4190-8e47-e0d35881f7c5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:22.144611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-475ed325-9501-4190-8e47-e0d35881f7c5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.179756 Dec 15 16:42:22.145178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 937/2085] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:21 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:22.307126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:22.307993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:22.318548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:22.319285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:22.320698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:22.321414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:22.476118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:22.488417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:22.489909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:22.491180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0ad877c2-a682-4779-96c8-3fa55ead9361 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.190615 Dec 15 16:42:22.491738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1149/2086] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:23.063696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:42:23.064158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:42:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:42:23.162837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-454adab6-cf44-41f2-baea-d3e03ae30b3f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:23.163482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-454adab6-cf44-41f2-baea-d3e03ae30b3f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:23.170483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-454adab6-cf44-41f2-baea-d3e03ae30b3f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:23.170932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-454adab6-cf44-41f2-baea-d3e03ae30b3f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:23.171710 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-454adab6-cf44-41f2-baea-d3e03ae30b3f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:23.172143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-454adab6-cf44-41f2-baea-d3e03ae30b3f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:23.304382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-454adab6-cf44-41f2-baea-d3e03ae30b3f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:23.312313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-454adab6-cf44-41f2-baea-d3e03ae30b3f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.153517 Dec 15 16:42:23.312928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 938/2087] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:23 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:23.514523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:23.515437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:23.525882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:23.526619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:23.527921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:23.528649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:23.669422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:23.678014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:23.679472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:23.680641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1b8815cb-a89b-44ed-b69f-2d18a0e183d4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172477 Dec 15 16:42:23.681196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1150/2088] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:24.334086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3ab6440d-c8da-4130-b99f-7d09d46346e2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:24.335024 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3ab6440d-c8da-4130-b99f-7d09d46346e2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:24.346186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ab6440d-c8da-4130-b99f-7d09d46346e2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:24.346926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ab6440d-c8da-4130-b99f-7d09d46346e2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:24.347723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ab6440d-c8da-4130-b99f-7d09d46346e2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:24.348160 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3ab6440d-c8da-4130-b99f-7d09d46346e2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:24.488933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3ab6440d-c8da-4130-b99f-7d09d46346e2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:24.497207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3ab6440d-c8da-4130-b99f-7d09d46346e2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169506 Dec 15 16:42:24.497764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 939/2089] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:24 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:24.702161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:24.702775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:24.710588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:24.711034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:24.711784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:24.712232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:24.860175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:24.869513 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:24.870988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:24.872130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0628a001-5d73-477c-84d0-a2fa4a4d4b9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.176210 Dec 15 16:42:24.872726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1151/2090] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:25.518586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-186c4b0f-7ebf-4b24-bb15-612b66e5ef6b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:25.519808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-186c4b0f-7ebf-4b24-bb15-612b66e5ef6b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:25.526591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-186c4b0f-7ebf-4b24-bb15-612b66e5ef6b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:25.527038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-186c4b0f-7ebf-4b24-bb15-612b66e5ef6b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:25.527821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-186c4b0f-7ebf-4b24-bb15-612b66e5ef6b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:25.528284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-186c4b0f-7ebf-4b24-bb15-612b66e5ef6b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:25.660859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-186c4b0f-7ebf-4b24-bb15-612b66e5ef6b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:25.669379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-186c4b0f-7ebf-4b24-bb15-612b66e5ef6b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.157261 Dec 15 16:42:25.669956 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 940/2091] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:25 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:25.894653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:25.895780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:25.906324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:25.907062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:25.908327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:25.909095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:26.061619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:26.070900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:26.072358 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:26.073649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c2f9f825-e37c-485d-b4d6-8430ff519d81 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.185386 Dec 15 16:42:26.074198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1152/2092] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:26.692727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-25b7ec64-6e0c-4feb-94ce-f6462d3b52b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:26.693351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-25b7ec64-6e0c-4feb-94ce-f6462d3b52b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:26.700112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25b7ec64-6e0c-4feb-94ce-f6462d3b52b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:26.700597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25b7ec64-6e0c-4feb-94ce-f6462d3b52b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:26.701377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25b7ec64-6e0c-4feb-94ce-f6462d3b52b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:26.701814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25b7ec64-6e0c-4feb-94ce-f6462d3b52b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:26.839735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-25b7ec64-6e0c-4feb-94ce-f6462d3b52b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:26.851549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-25b7ec64-6e0c-4feb-94ce-f6462d3b52b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.162433 Dec 15 16:42:26.852637 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 941/2093] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:26 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:27.100074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:27.100689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:27.107526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:27.107978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:27.108791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:27.109226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:27.246104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:27.257575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:27.259040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:27.260176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3dac8e6a-a119-473a-9e99-349b3560e256 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165728 Dec 15 16:42:27.260756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1153/2094] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:27.877802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4f60b0d8-37a4-436b-a901-7b3be606af6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:27.878813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4f60b0d8-37a4-436b-a901-7b3be606af6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:27.886236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f60b0d8-37a4-436b-a901-7b3be606af6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:27.886705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f60b0d8-37a4-436b-a901-7b3be606af6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:27.887517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f60b0d8-37a4-436b-a901-7b3be606af6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:27.887966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f60b0d8-37a4-436b-a901-7b3be606af6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:28.035250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4f60b0d8-37a4-436b-a901-7b3be606af6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:28.043711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4f60b0d8-37a4-436b-a901-7b3be606af6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172118 Dec 15 16:42:28.044322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 942/2095] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:27 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:28.278471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:28.279030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:28.285860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:28.286333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:28.287079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:28.287504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:28.427597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:28.436191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:28.437732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:28.438887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dc8fed28-f448-45fe-8013-3915efa7d098 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.164151 Dec 15 16:42:28.439441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1154/2096] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:29.065295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2a9744f9-5076-4314-979c-8a643d6f9fb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:29.066445 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2a9744f9-5076-4314-979c-8a643d6f9fb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:29.077863 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a9744f9-5076-4314-979c-8a643d6f9fb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:29.078605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a9744f9-5076-4314-979c-8a643d6f9fb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:29.079967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a9744f9-5076-4314-979c-8a643d6f9fb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:29.080753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2a9744f9-5076-4314-979c-8a643d6f9fb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:29.219629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2a9744f9-5076-4314-979c-8a643d6f9fb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:29.231594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2a9744f9-5076-4314-979c-8a643d6f9fb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172310 Dec 15 16:42:29.232501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 943/2097] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:29 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:29.461485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:29.462479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:29.473394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:29.474083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:29.474839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:29.475266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:29.621864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:29.631242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:29.632772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:29.633995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4b12811b-0500-4b9a-8e5c-61878181399c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179232 Dec 15 16:42:29.634562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1155/2098] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:30.256397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dd9cee8d-9fa7-4627-92da-d4884111208c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:30.261326 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dd9cee8d-9fa7-4627-92da-d4884111208c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:30.267950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd9cee8d-9fa7-4627-92da-d4884111208c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:30.268408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd9cee8d-9fa7-4627-92da-d4884111208c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:30.269424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd9cee8d-9fa7-4627-92da-d4884111208c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:30.269882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd9cee8d-9fa7-4627-92da-d4884111208c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:30.412124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dd9cee8d-9fa7-4627-92da-d4884111208c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:30.424815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dd9cee8d-9fa7-4627-92da-d4884111208c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.175073 Dec 15 16:42:30.425678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 944/2099] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:30 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:30.652090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:30.652673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:30.659415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:30.659865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:30.660674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:30.661161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:30.796687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:30.805610 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:30.807093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:30.808242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-81636d73-54ac-43f5-8bd9-0c5cb13d9fcd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160015 Dec 15 16:42:30.808833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1156/2100] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:31.446720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-00b4c46f-36d0-440d-8b37-55ca24e06f1b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:31.447625 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-00b4c46f-36d0-440d-8b37-55ca24e06f1b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:31.458395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00b4c46f-36d0-440d-8b37-55ca24e06f1b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:31.458845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00b4c46f-36d0-440d-8b37-55ca24e06f1b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:31.459627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00b4c46f-36d0-440d-8b37-55ca24e06f1b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:31.460055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00b4c46f-36d0-440d-8b37-55ca24e06f1b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:31.600125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-00b4c46f-36d0-440d-8b37-55ca24e06f1b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:31.609472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-00b4c46f-36d0-440d-8b37-55ca24e06f1b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169393 Dec 15 16:42:31.610061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 945/2101] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:31 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:31.830724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:31.831632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:31.843039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:31.843783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:31.845102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:31.845812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:31.994383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:32.007468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:32.009823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:32.011576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ff2d4134-0013-410c-88cd-cd672f12b676 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.186875 Dec 15 16:42:32.012342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1157/2102] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:32.630932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cce63add-af1a-42c1-8cf6-78f2057cd49d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:32.631566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cce63add-af1a-42c1-8cf6-78f2057cd49d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:32.638541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cce63add-af1a-42c1-8cf6-78f2057cd49d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:32.639022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cce63add-af1a-42c1-8cf6-78f2057cd49d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:32.639846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cce63add-af1a-42c1-8cf6-78f2057cd49d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:32.640299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cce63add-af1a-42c1-8cf6-78f2057cd49d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:32.775497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cce63add-af1a-42c1-8cf6-78f2057cd49d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:32.783924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cce63add-af1a-42c1-8cf6-78f2057cd49d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.159310 Dec 15 16:42:32.784497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 946/2103] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:32 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:33.037727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:33.038330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:33.044797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:33.045260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:33.046039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:33.046470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:33.178854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:33.187126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:33.188624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:33.189758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a05fc686-740b-45a9-9a23-f52129f4d2fb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.158536 Dec 15 16:42:33.190283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1158/2104] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:33.809707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0d73720f-0b89-4185-b340-28269d6f1012 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:33.810897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0d73720f-0b89-4185-b340-28269d6f1012 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:33.819997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d73720f-0b89-4185-b340-28269d6f1012 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:33.820468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d73720f-0b89-4185-b340-28269d6f1012 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:33.821254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d73720f-0b89-4185-b340-28269d6f1012 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:33.821682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d73720f-0b89-4185-b340-28269d6f1012 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:33.975558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0d73720f-0b89-4185-b340-28269d6f1012 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:33.988362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0d73720f-0b89-4185-b340-28269d6f1012 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.184427 Dec 15 16:42:33.989390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 947/2105] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:33 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:34.212285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:34.213338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:34.224417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:34.225223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:34.226502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:34.227235 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:34.369612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:34.378660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:34.380113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:34.381408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-805037b9-b402-4adf-a94c-3b05cdee45f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175493 Dec 15 16:42:34.381942 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1159/2106] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:35.015223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4f4f4d33-d838-45ac-a522-5a0c8f0317d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:35.016208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4f4f4d33-d838-45ac-a522-5a0c8f0317d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:35.024774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f4f4d33-d838-45ac-a522-5a0c8f0317d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:35.025220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f4f4d33-d838-45ac-a522-5a0c8f0317d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:35.026005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f4f4d33-d838-45ac-a522-5a0c8f0317d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:35.026428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4f4f4d33-d838-45ac-a522-5a0c8f0317d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:35.164518 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4f4f4d33-d838-45ac-a522-5a0c8f0317d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:35.172322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4f4f4d33-d838-45ac-a522-5a0c8f0317d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163268 Dec 15 16:42:35.172924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 948/2107] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:35 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:35.402782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:35.403784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:35.413280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:35.413722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:35.414492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:35.414918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:35.553127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:35.561799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:35.563265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:35.564473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1e0dc6d4-8042-4429-bcca-120f96129d97 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.167931 Dec 15 16:42:35.565020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1160/2108] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:36.189306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-be93bddf-1a39-4345-b912-c834a1084a38 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:36.189883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-be93bddf-1a39-4345-b912-c834a1084a38 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:36.198992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be93bddf-1a39-4345-b912-c834a1084a38 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:36.199435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be93bddf-1a39-4345-b912-c834a1084a38 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:36.200217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be93bddf-1a39-4345-b912-c834a1084a38 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:36.200684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-be93bddf-1a39-4345-b912-c834a1084a38 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:36.342280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-be93bddf-1a39-4345-b912-c834a1084a38 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:36.350854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-be93bddf-1a39-4345-b912-c834a1084a38 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.165346 Dec 15 16:42:36.351425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 949/2109] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:36 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:36.587438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:36.588361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:36.599331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:36.600510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:36.601833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:36.602558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:36.741253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:36.749680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:36.751171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:36.752323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3ffce184-0326-442a-be36-3f22c908cd34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171383 Dec 15 16:42:36.753000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1161/2110] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:37.369154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dadc512f-67c3-4959-967b-570578a99b67 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:37.369747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dadc512f-67c3-4959-967b-570578a99b67 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:37.376852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dadc512f-67c3-4959-967b-570578a99b67 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:37.377304 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dadc512f-67c3-4959-967b-570578a99b67 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:37.378058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dadc512f-67c3-4959-967b-570578a99b67 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:37.378483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dadc512f-67c3-4959-967b-570578a99b67 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:37.521936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dadc512f-67c3-4959-967b-570578a99b67 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:37.534592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dadc512f-67c3-4959-967b-570578a99b67 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169770 Dec 15 16:42:37.536732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 950/2111] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:37 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:37.771201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:37.771811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:37.781598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:37.782041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:37.783158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:37.783750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:37.921051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:37.929676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:37.931230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:37.932363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4ed30593-2d8b-4633-8c00-dcc95156405a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165049 Dec 15 16:42:37.932994 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1162/2112] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:38.557141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0aebd72e-422c-42a8-b6d0-cd777eeb81ff tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:38.558151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0aebd72e-422c-42a8-b6d0-cd777eeb81ff tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:38.569312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0aebd72e-422c-42a8-b6d0-cd777eeb81ff tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:38.570110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0aebd72e-422c-42a8-b6d0-cd777eeb81ff tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:38.571072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0aebd72e-422c-42a8-b6d0-cd777eeb81ff tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:38.571506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0aebd72e-422c-42a8-b6d0-cd777eeb81ff tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:38.718841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0aebd72e-422c-42a8-b6d0-cd777eeb81ff tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:38.728664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0aebd72e-422c-42a8-b6d0-cd777eeb81ff tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.178367 Dec 15 16:42:38.729233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 951/2113] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:38 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:38.954719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:38.955986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:38.964690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:38.965123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:38.965938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:38.966720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:39.103832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:39.117678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:39.119178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:39.120327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5eea32e0-7ea0-447c-b3fd-58d9c098c196 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171807 Dec 15 16:42:39.120994 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1163/2114] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:39.755194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8da57f6c-6076-4f29-9c38-9b77f5c24f99 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:39.756159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8da57f6c-6076-4f29-9c38-9b77f5c24f99 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:39.763403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8da57f6c-6076-4f29-9c38-9b77f5c24f99 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:39.763854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8da57f6c-6076-4f29-9c38-9b77f5c24f99 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:39.764683 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8da57f6c-6076-4f29-9c38-9b77f5c24f99 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:39.765114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8da57f6c-6076-4f29-9c38-9b77f5c24f99 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:39.909955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8da57f6c-6076-4f29-9c38-9b77f5c24f99 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:39.918778 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8da57f6c-6076-4f29-9c38-9b77f5c24f99 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170066 Dec 15 16:42:39.919380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 952/2115] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:39 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:40.141619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:40.142433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:40.150521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:40.150975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:40.151759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:40.152197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:40.302536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:40.316850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:40.318359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:40.319544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e6680bb3-5eb7-469a-9b51-4f9b6745356b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.183053 Dec 15 16:42:40.320315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1164/2116] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:40.939472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-45911046-3b28-4331-bb27-91326170fe9a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:40.940498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-45911046-3b28-4331-bb27-91326170fe9a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:40.951156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45911046-3b28-4331-bb27-91326170fe9a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:40.951902 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45911046-3b28-4331-bb27-91326170fe9a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:40.953246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45911046-3b28-4331-bb27-91326170fe9a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:40.953962 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-45911046-3b28-4331-bb27-91326170fe9a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:41.095581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-45911046-3b28-4331-bb27-91326170fe9a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:41.108020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-45911046-3b28-4331-bb27-91326170fe9a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.174442 Dec 15 16:42:41.108826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 953/2117] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:40 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:41.343207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:41.344115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:41.353726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:41.354171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:41.354940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:41.355365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:41.486119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:41.494537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:41.495966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:41.497178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6280e7ef-1365-47ff-8b3d-5edb36b078a7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160996 Dec 15 16:42:41.497697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1165/2118] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:42.132264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e8a6a308-22f1-462a-961b-4abedb55048a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:42.133366 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e8a6a308-22f1-462a-961b-4abedb55048a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:42.139959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8a6a308-22f1-462a-961b-4abedb55048a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:42.140410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8a6a308-22f1-462a-961b-4abedb55048a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:42.141232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8a6a308-22f1-462a-961b-4abedb55048a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:42.141667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8a6a308-22f1-462a-961b-4abedb55048a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:42.296472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e8a6a308-22f1-462a-961b-4abedb55048a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:42.306632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e8a6a308-22f1-462a-961b-4abedb55048a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.180641 Dec 15 16:42:42.307227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 954/2119] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:42 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:42.519205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:42.520145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:42.528339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:42.528824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:42.529598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:42.530037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:42.672320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:42.681517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:42.682989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:42.684130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e5a55a1c-d1ea-4e09-9232-f39d2faa9c8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171117 Dec 15 16:42:42.684715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1166/2120] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:43.327274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5b053265-0c53-43e9-bae3-638a3bd7052a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:43.328245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5b053265-0c53-43e9-bae3-638a3bd7052a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:43.338576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b053265-0c53-43e9-bae3-638a3bd7052a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:43.339025 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b053265-0c53-43e9-bae3-638a3bd7052a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:43.339799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b053265-0c53-43e9-bae3-638a3bd7052a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:43.340228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b053265-0c53-43e9-bae3-638a3bd7052a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:43.483988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5b053265-0c53-43e9-bae3-638a3bd7052a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:43.491969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5b053265-0c53-43e9-bae3-638a3bd7052a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.171266 Dec 15 16:42:43.492538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 955/2121] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:43 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:43.706973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:43.707854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:43.719388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:43.720129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:43.721473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:43.722193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:43.861508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:43.870102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:43.871580 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:43.872757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-de5da091-28b8-44e2-8258-77192a96a7a1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172244 Dec 15 16:42:43.873317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1167/2122] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:44.510533 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-28fce48d-205e-4241-9556-ea0133ada71f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:44.511158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-28fce48d-205e-4241-9556-ea0133ada71f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:44.517819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-28fce48d-205e-4241-9556-ea0133ada71f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:44.518263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-28fce48d-205e-4241-9556-ea0133ada71f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:44.519045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-28fce48d-205e-4241-9556-ea0133ada71f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:44.519503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-28fce48d-205e-4241-9556-ea0133ada71f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:44.654931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-28fce48d-205e-4241-9556-ea0133ada71f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:44.663449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-28fce48d-205e-4241-9556-ea0133ada71f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.156944 Dec 15 16:42:44.664022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 956/2123] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:44 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:44.894083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:44.894706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:44.903173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:44.903618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:44.904390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:44.904858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:45.041611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:45.050842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:45.052345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:45.053509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-daa54697-a3fc-4d28-91af-b42d33bb9dfb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165591 Dec 15 16:42:45.054067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1168/2124] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:45.685748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6df1bce5-5460-4aa2-82a9-92ac421d3c95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:45.686630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6df1bce5-5460-4aa2-82a9-92ac421d3c95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:45.694000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6df1bce5-5460-4aa2-82a9-92ac421d3c95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:45.694443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6df1bce5-5460-4aa2-82a9-92ac421d3c95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:45.695395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6df1bce5-5460-4aa2-82a9-92ac421d3c95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:45.695838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6df1bce5-5460-4aa2-82a9-92ac421d3c95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:45.842119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6df1bce5-5460-4aa2-82a9-92ac421d3c95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:45.855048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6df1bce5-5460-4aa2-82a9-92ac421d3c95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.175523 Dec 15 16:42:45.856030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 957/2125] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:45 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:46.072602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:46.073291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:46.081501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:46.083341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:46.084517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:46.084960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:46.257939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:46.268878 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:46.270371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:46.271563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eb5e4245-0875-4c42-81ec-a9cb23483677 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.203180 Dec 15 16:42:46.272272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1169/2126] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:46.877673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-60952c05-e2e2-496d-89c1-a682fd3c49a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:46.878640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-60952c05-e2e2-496d-89c1-a682fd3c49a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:46.890336 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60952c05-e2e2-496d-89c1-a682fd3c49a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:46.891078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60952c05-e2e2-496d-89c1-a682fd3c49a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:46.892368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60952c05-e2e2-496d-89c1-a682fd3c49a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:46.893145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-60952c05-e2e2-496d-89c1-a682fd3c49a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:47.037976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-60952c05-e2e2-496d-89c1-a682fd3c49a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:47.046387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-60952c05-e2e2-496d-89c1-a682fd3c49a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.174966 Dec 15 16:42:47.046967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 958/2127] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:46 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:47.293615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:47.294194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:47.301483 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:47.301974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:47.302830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:47.303304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:47.443917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:47.452647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:47.454123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:47.455332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dd8a7ab4-921e-4edc-b07f-c55f05089ee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.167241 Dec 15 16:42:47.455890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1170/2128] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:48.065198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-71880fcc-dc02-4166-9393-43b40b10892a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:48.065886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-71880fcc-dc02-4166-9393-43b40b10892a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:48.073968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71880fcc-dc02-4166-9393-43b40b10892a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:48.074409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71880fcc-dc02-4166-9393-43b40b10892a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:48.075189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71880fcc-dc02-4166-9393-43b40b10892a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:48.075620 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-71880fcc-dc02-4166-9393-43b40b10892a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:48.237943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-71880fcc-dc02-4166-9393-43b40b10892a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:48.247851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-71880fcc-dc02-4166-9393-43b40b10892a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.187613 Dec 15 16:42:48.248467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 959/2129] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:48 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:48.484126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:48.485082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:48.495554 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:48.496008 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:48.496906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:48.497345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:48.646129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:48.659075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:48.661448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:48.663131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-02707157-dc19-4d52-a039-b3a25e251f34 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.185091 Dec 15 16:42:48.663889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1171/2130] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:48 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:49.269538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa85c804-ae4e-40f2-b438-35895b3451fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:49.270529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa85c804-ae4e-40f2-b438-35895b3451fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:49.279355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa85c804-ae4e-40f2-b438-35895b3451fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:49.279798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa85c804-ae4e-40f2-b438-35895b3451fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:49.280615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa85c804-ae4e-40f2-b438-35895b3451fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:49.281043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa85c804-ae4e-40f2-b438-35895b3451fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:49.420069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa85c804-ae4e-40f2-b438-35895b3451fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:49.431413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa85c804-ae4e-40f2-b438-35895b3451fb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167830 Dec 15 16:42:49.432180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 960/2131] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:49 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:49.686710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:49.687631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:49.698195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:49.698648 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:49.699435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:49.699869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:49.853394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:49.867097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:49.869483 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:49.870724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7daac809-bdd1-440c-9eeb-d3a29e01e709 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.190403 Dec 15 16:42:49.871271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1172/2132] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:50.450482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-985f5532-a399-4191-b9cf-6604406658be tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:50.451070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-985f5532-a399-4191-b9cf-6604406658be tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:50.457833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-985f5532-a399-4191-b9cf-6604406658be tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:50.458281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-985f5532-a399-4191-b9cf-6604406658be tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:50.459062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-985f5532-a399-4191-b9cf-6604406658be tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:50.459504 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-985f5532-a399-4191-b9cf-6604406658be tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:50.597843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-985f5532-a399-4191-b9cf-6604406658be tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:50.607820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-985f5532-a399-4191-b9cf-6604406658be tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161240 Dec 15 16:42:50.608762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 961/2133] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:50 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:50.892397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:50.893430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:50.904339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:50.905131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:50.906456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:50.907173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:51.048420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:51.060550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:51.062955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:51.064751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d9549249-8bfc-4dd1-89d5-5a6b567c3719 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.178501 Dec 15 16:42:51.065491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1173/2134] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:51.633053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4ac1a5ab-630e-4756-b059-2819cb105725 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:51.634048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4ac1a5ab-630e-4756-b059-2819cb105725 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:51.642280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ac1a5ab-630e-4756-b059-2819cb105725 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:51.642730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ac1a5ab-630e-4756-b059-2819cb105725 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:51.643515 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ac1a5ab-630e-4756-b059-2819cb105725 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:51.643952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4ac1a5ab-630e-4756-b059-2819cb105725 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:51.788120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4ac1a5ab-630e-4756-b059-2819cb105725 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:51.796597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4ac1a5ab-630e-4756-b059-2819cb105725 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169949 Dec 15 16:42:51.797178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 962/2135] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:51 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:52.086849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:52.087456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:52.094562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:52.095003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:52.095778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:52.096209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:52.230221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:52.238806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:52.240272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:52.241515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-97289e98-2ad7-4cbe-b6cd-0339f86eef69 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.158536 Dec 15 16:42:52.242075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1174/2136] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:52.817083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-26a4d15e-08d4-4461-9b11-086052f592dc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:52.818133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-26a4d15e-08d4-4461-9b11-086052f592dc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:52.828931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26a4d15e-08d4-4461-9b11-086052f592dc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:52.829674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26a4d15e-08d4-4461-9b11-086052f592dc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:52.830993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26a4d15e-08d4-4461-9b11-086052f592dc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:52.831713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-26a4d15e-08d4-4461-9b11-086052f592dc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:52.976228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-26a4d15e-08d4-4461-9b11-086052f592dc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:52.987764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-26a4d15e-08d4-4461-9b11-086052f592dc tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.176623 Dec 15 16:42:52.988583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 963/2137] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:52 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:53.264598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:53.265224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:53.272273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:53.272759 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:53.273549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:53.273990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:53.433221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:53.446087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:53.448040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:53.449746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-93b6b9bd-db83-40dc-83af-9b6c7fcf2a3b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.189800 Dec 15 16:42:53.450317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1175/2138] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:54.009084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cd7f117c-e925-40d1-b8d1-19bc259b6948 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:54.010100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cd7f117c-e925-40d1-b8d1-19bc259b6948 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:54.019202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd7f117c-e925-40d1-b8d1-19bc259b6948 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:54.019707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd7f117c-e925-40d1-b8d1-19bc259b6948 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:54.020459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd7f117c-e925-40d1-b8d1-19bc259b6948 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:54.021203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd7f117c-e925-40d1-b8d1-19bc259b6948 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:54.161800 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cd7f117c-e925-40d1-b8d1-19bc259b6948 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:54.170691 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cd7f117c-e925-40d1-b8d1-19bc259b6948 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167766 Dec 15 16:42:54.171286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 964/2139] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:54 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:54.468065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:54.468697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:54.475400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:54.475849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:54.476669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:54.477101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:54.618856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:54.632157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:54.634518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:54.636281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-987aede0-ceb3-4a3c-9c70-8ab5f357e65b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172445 Dec 15 16:42:54.637035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1176/2140] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:55.191877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5dade649-f15e-43d3-88ec-0d339e971d36 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:55.192931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5dade649-f15e-43d3-88ec-0d339e971d36 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:55.203615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5dade649-f15e-43d3-88ec-0d339e971d36 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:55.204348 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5dade649-f15e-43d3-88ec-0d339e971d36 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:55.205695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5dade649-f15e-43d3-88ec-0d339e971d36 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:55.206409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5dade649-f15e-43d3-88ec-0d339e971d36 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:55.355590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5dade649-f15e-43d3-88ec-0d339e971d36 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:55.364353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5dade649-f15e-43d3-88ec-0d339e971d36 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.178804 Dec 15 16:42:55.364969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 965/2141] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:55 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:55.659319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:55.660260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:55.670151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:55.670603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:55.671393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:55.671829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:55.811847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:55.820881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:55.822359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:55.823516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-41d64c16-2fb0-4261-909a-932bf9b1ab0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.170841 Dec 15 16:42:55.824078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1177/2142] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:56.385776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6bdc12a6-d733-418b-bc50-02b9e382b305 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:56.386701 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6bdc12a6-d733-418b-bc50-02b9e382b305 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:56.393760 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6bdc12a6-d733-418b-bc50-02b9e382b305 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:56.394212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6bdc12a6-d733-418b-bc50-02b9e382b305 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:56.394981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6bdc12a6-d733-418b-bc50-02b9e382b305 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:56.395407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6bdc12a6-d733-418b-bc50-02b9e382b305 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:56.533407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6bdc12a6-d733-418b-bc50-02b9e382b305 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:56.544474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6bdc12a6-d733-418b-bc50-02b9e382b305 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164657 Dec 15 16:42:56.545244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 966/2143] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:56 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:56.852891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:56.853894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:56.862241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:56.862688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:56.863467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:56.863898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:57.003775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:57.014379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:57.015878 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:57.017081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fbf8df82-8bd8-4c15-bb8e-65b5a8de8b4b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.170637 Dec 15 16:42:57.017770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1178/2144] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:57.570945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e4b706a8-2abd-4dc2-b5a7-c9028db0ddd9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:57.572040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e4b706a8-2abd-4dc2-b5a7-c9028db0ddd9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:57.580889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4b706a8-2abd-4dc2-b5a7-c9028db0ddd9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:57.581343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4b706a8-2abd-4dc2-b5a7-c9028db0ddd9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:57.582121 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4b706a8-2abd-4dc2-b5a7-c9028db0ddd9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:57.582547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4b706a8-2abd-4dc2-b5a7-c9028db0ddd9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:57.717944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e4b706a8-2abd-4dc2-b5a7-c9028db0ddd9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:57.727443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e4b706a8-2abd-4dc2-b5a7-c9028db0ddd9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.162822 Dec 15 16:42:57.728017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 967/2145] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:57 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:58.036266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:58.036900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:58.044611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:58.045136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:58.045980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:58.046459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:58.197050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:58.209058 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:58.210557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:58.211748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-59b20bf3-35bc-4b32-9a16-ac35d40cfc32 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179758 Dec 15 16:42:58.212281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1179/2146] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:58.750724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2aacbc99-3924-4d23-9102-c0aab4036687 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:58.751498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2aacbc99-3924-4d23-9102-c0aab4036687 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:58.759849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2aacbc99-3924-4d23-9102-c0aab4036687 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:58.760453 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2aacbc99-3924-4d23-9102-c0aab4036687 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:58.761441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2aacbc99-3924-4d23-9102-c0aab4036687 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:58.761975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2aacbc99-3924-4d23-9102-c0aab4036687 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:58.914980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2aacbc99-3924-4d23-9102-c0aab4036687 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:58.925296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2aacbc99-3924-4d23-9102-c0aab4036687 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.180059 Dec 15 16:42:58.926125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 968/2147] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:58 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:42:59.232980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:59.233699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:59.241989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:59.242559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:59.243542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:59.244094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:59.385047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:59.394528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:59.396003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:42:59.397185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-81dee146-b40b-4479-8b8e-fbc46cd821f6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.169235 Dec 15 16:42:59.397745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1180/2148] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:42:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:42:59.949653 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f991f327-aede-4339-98ae-cac31ba26ebd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:42:59.950696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f991f327-aede-4339-98ae-cac31ba26ebd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:42:59.957306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f991f327-aede-4339-98ae-cac31ba26ebd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:59.957758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f991f327-aede-4339-98ae-cac31ba26ebd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:42:59.958549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f991f327-aede-4339-98ae-cac31ba26ebd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:42:59.958968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f991f327-aede-4339-98ae-cac31ba26ebd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:00.091199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f991f327-aede-4339-98ae-cac31ba26ebd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:00.100362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f991f327-aede-4339-98ae-cac31ba26ebd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.156993 Dec 15 16:43:00.100993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 969/2149] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:42:59 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:00.422624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:00.423363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:00.431583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:00.432145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:00.433252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:00.433804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:00.586150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:00.599654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:00.601818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:00.602972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0800fbd1-e460-4566-bc54-c1dedcf28f42 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.185123 Dec 15 16:43:00.603547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1181/2150] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:01.121449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7749d1e8-7ebf-4bb6-9ec5-fbfe1111319a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:01.122485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7749d1e8-7ebf-4bb6-9ec5-fbfe1111319a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:01.129479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7749d1e8-7ebf-4bb6-9ec5-fbfe1111319a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:01.129934 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7749d1e8-7ebf-4bb6-9ec5-fbfe1111319a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:01.130728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7749d1e8-7ebf-4bb6-9ec5-fbfe1111319a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:01.131168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7749d1e8-7ebf-4bb6-9ec5-fbfe1111319a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:01.270433 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7749d1e8-7ebf-4bb6-9ec5-fbfe1111319a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:01.279370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7749d1e8-7ebf-4bb6-9ec5-fbfe1111319a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163784 Dec 15 16:43:01.279967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 970/2151] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:01 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:01.625867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:01.626813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:01.637427 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:01.638160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:01.639462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:01.639838 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:01.779871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:01.788583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:01.790063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:01.791203 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-09b21ad8-fac6-4d33-9e9a-cc99fed224ff tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171632 Dec 15 16:43:01.791758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1182/2152] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:02.301268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7e5ab623-b575-4346-b487-c1d75e799979 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:02.302113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7e5ab623-b575-4346-b487-c1d75e799979 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:02.313161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7e5ab623-b575-4346-b487-c1d75e799979 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:02.314199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7e5ab623-b575-4346-b487-c1d75e799979 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:02.316689 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7e5ab623-b575-4346-b487-c1d75e799979 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:02.316689 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7e5ab623-b575-4346-b487-c1d75e799979 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:02.462961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7e5ab623-b575-4346-b487-c1d75e799979 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:02.472221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7e5ab623-b575-4346-b487-c1d75e799979 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.177980 Dec 15 16:43:02.472823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 971/2153] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:02 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:02.813497 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:02.814547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:02.825176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:02.825919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:02.827152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:02.827574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:02.978806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:02.987434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:02.988959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:02.990111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-db460c9b-b864-4f76-a9ef-e5a498eae946 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.182904 Dec 15 16:43:02.990677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1183/2154] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:03.492101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c5758c9e-e7b0-4eae-b80d-1bff17007a5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:03.492859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c5758c9e-e7b0-4eae-b80d-1bff17007a5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:03.501463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5758c9e-e7b0-4eae-b80d-1bff17007a5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:03.502057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5758c9e-e7b0-4eae-b80d-1bff17007a5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:03.503097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5758c9e-e7b0-4eae-b80d-1bff17007a5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:03.503678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c5758c9e-e7b0-4eae-b80d-1bff17007a5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:03.642730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c5758c9e-e7b0-4eae-b80d-1bff17007a5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:03.651090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c5758c9e-e7b0-4eae-b80d-1bff17007a5b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164093 Dec 15 16:43:03.651698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 972/2155] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:03 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:04.012149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:04.013167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:04.024214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:04.025000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:04.026288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:04.027003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:04.175241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:04.187137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:04.188647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:04.189792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b8044d6e-9b30-41c1-bec4-7a4f4e72b009 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.183800 Dec 15 16:43:04.190351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1184/2156] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:04.673482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-336f3fb2-dca2-465d-9a17-849c658e9dea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:04.674483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-336f3fb2-dca2-465d-9a17-849c658e9dea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:04.685183 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-336f3fb2-dca2-465d-9a17-849c658e9dea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:04.685931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-336f3fb2-dca2-465d-9a17-849c658e9dea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:04.686976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-336f3fb2-dca2-465d-9a17-849c658e9dea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:04.687521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-336f3fb2-dca2-465d-9a17-849c658e9dea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:04.841250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-336f3fb2-dca2-465d-9a17-849c658e9dea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:04.850554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-336f3fb2-dca2-465d-9a17-849c658e9dea tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.183331 Dec 15 16:43:04.851164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 973/2157] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:04 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:05.219541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:05.220585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:05.231258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:05.231964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:05.233399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:05.233876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:05.381624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:05.390395 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:05.391864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:05.393078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-115c0eda-2d97-443d-b4d1-34b715de3f25 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180406 Dec 15 16:43:05.393627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1185/2158] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:05.871754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-670b2826-df42-44fe-882d-0bfe2ec1e7b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:05.872935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-670b2826-df42-44fe-882d-0bfe2ec1e7b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:05.883944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-670b2826-df42-44fe-882d-0bfe2ec1e7b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:05.884856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-670b2826-df42-44fe-882d-0bfe2ec1e7b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:05.886150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-670b2826-df42-44fe-882d-0bfe2ec1e7b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:05.886891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-670b2826-df42-44fe-882d-0bfe2ec1e7b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:06.024957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-670b2826-df42-44fe-882d-0bfe2ec1e7b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:06.033700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-670b2826-df42-44fe-882d-0bfe2ec1e7b7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168163 Dec 15 16:43:06.034252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 974/2159] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:05 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:06.416216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:06.417159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:06.428138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:06.428952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:06.430253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:06.430982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:06.569329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:06.578536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:06.580020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:06.581208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c954b6f8-1223-48a0-b923-fc4d09bec6b7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172153 Dec 15 16:43:06.581765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1186/2160] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:07.056163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-55222d16-1243-4ce4-9907-ac8c37d257fa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:07.057000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-55222d16-1243-4ce4-9907-ac8c37d257fa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:07.064418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55222d16-1243-4ce4-9907-ac8c37d257fa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:07.064897 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55222d16-1243-4ce4-9907-ac8c37d257fa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:07.065690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55222d16-1243-4ce4-9907-ac8c37d257fa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:07.066129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-55222d16-1243-4ce4-9907-ac8c37d257fa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:07.200393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-55222d16-1243-4ce4-9907-ac8c37d257fa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:07.212419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-55222d16-1243-4ce4-9907-ac8c37d257fa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.160418 Dec 15 16:43:07.213260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 975/2161] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:07 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:07.604083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:07.605861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:07.612935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:07.613378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:07.614147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:07.614893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:07.754479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:07.762843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:07.764297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:07.765494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a49ded43-4f36-4d1b-bd4b-74ce63e16b92 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.167648 Dec 15 16:43:07.766026 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1187/2162] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:08.237138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0014f22b-a99e-4e79-ae4b-1e13e7e9d3ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:08.238140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0014f22b-a99e-4e79-ae4b-1e13e7e9d3ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:08.248780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0014f22b-a99e-4e79-ae4b-1e13e7e9d3ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:08.249656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0014f22b-a99e-4e79-ae4b-1e13e7e9d3ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:08.251019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0014f22b-a99e-4e79-ae4b-1e13e7e9d3ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:08.251735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0014f22b-a99e-4e79-ae4b-1e13e7e9d3ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:08.388610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0014f22b-a99e-4e79-ae4b-1e13e7e9d3ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:08.403005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0014f22b-a99e-4e79-ae4b-1e13e7e9d3ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.171755 Dec 15 16:43:08.403941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 976/2163] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:08 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:08.787885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:08.788844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:08.798218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:08.798666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:08.799435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:08.799862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:08.930484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:08.943576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:08.945252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:08.947050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-02d2b54d-58c1-4a88-91e7-d8c73a86dd64 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165310 Dec 15 16:43:08.948880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1188/2164] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:09.425896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1ae433a3-2401-426f-915d-4cb1c09af0ee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:09.426750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1ae433a3-2401-426f-915d-4cb1c09af0ee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:09.437237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ae433a3-2401-426f-915d-4cb1c09af0ee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:09.437682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ae433a3-2401-426f-915d-4cb1c09af0ee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:09.438455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ae433a3-2401-426f-915d-4cb1c09af0ee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:09.438885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1ae433a3-2401-426f-915d-4cb1c09af0ee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:09.587472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1ae433a3-2401-426f-915d-4cb1c09af0ee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:09.595964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1ae433a3-2401-426f-915d-4cb1c09af0ee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.176755 Dec 15 16:43:09.596550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 977/2165] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:09 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:09.973277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:09.974031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:09.982815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:09.984253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:09.985541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:09.986226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:10.124886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:10.133440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:10.134901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:10.136038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a3a69578-e098-4de4-8936-9a37e3c19662 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.167679 Dec 15 16:43:10.136614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1189/2166] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:10.613992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-52bea974-030c-45e3-b4f9-d8f804fe59d1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:10.614718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-52bea974-030c-45e3-b4f9-d8f804fe59d1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:10.621796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-52bea974-030c-45e3-b4f9-d8f804fe59d1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:10.622226 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-52bea974-030c-45e3-b4f9-d8f804fe59d1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:10.623022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-52bea974-030c-45e3-b4f9-d8f804fe59d1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:10.623486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-52bea974-030c-45e3-b4f9-d8f804fe59d1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:10.766351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-52bea974-030c-45e3-b4f9-d8f804fe59d1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:10.774472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-52bea974-030c-45e3-b4f9-d8f804fe59d1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164113 Dec 15 16:43:10.775278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 978/2167] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:10 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:10.831881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eed260e3-bcb0-4f38-9816-901c31ced073 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:10.832535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eed260e3-bcb0-4f38-9816-901c31ced073 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:10.838492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eed260e3-bcb0-4f38-9816-901c31ced073 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:10.838951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eed260e3-bcb0-4f38-9816-901c31ced073 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:10.839727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eed260e3-bcb0-4f38-9816-901c31ced073 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:10.840182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eed260e3-bcb0-4f38-9816-901c31ced073 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:10.865606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eed260e3-bcb0-4f38-9816-901c31ced073 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:43:10.943263 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eed260e3-bcb0-4f38-9816-901c31ced073 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 204 len: 0 microversion: 2.1 time: 0.114563 Dec 15 16:43:10.943953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1190/2168] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:43:10 2021] DELETE /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:43:10.952932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6760dfaf-e59c-495b-8450-32843b2c26f8 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:10.953565 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6760dfaf-e59c-495b-8450-32843b2c26f8 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:10.959692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6760dfaf-e59c-495b-8450-32843b2c26f8 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:10.960141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6760dfaf-e59c-495b-8450-32843b2c26f8 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:10.961068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6760dfaf-e59c-495b-8450-32843b2c26f8 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:10.961492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6760dfaf-e59c-495b-8450-32843b2c26f8 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:11.094856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6760dfaf-e59c-495b-8450-32843b2c26f8 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:11.102494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6760dfaf-e59c-495b-8450-32843b2c26f8 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1513 microversion: 2.1 time: 0.153610 Dec 15 16:43:11.103029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 979/2169] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:10 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:11.155847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:11.156569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:11.163493 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:11.163938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:11.164750 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:11.165182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:11.301450 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:11.309906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:11.311342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:11.312996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e31cbaac-b412-479d-babf-d61ffb9cea8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.161332 Dec 15 16:43:11.313615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1191/2170] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:11.792074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-81f85627-f679-4616-9ac1-16be8742c578 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:11.792786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-81f85627-f679-4616-9ac1-16be8742c578 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:11.799676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81f85627-f679-4616-9ac1-16be8742c578 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:11.800188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81f85627-f679-4616-9ac1-16be8742c578 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:11.801071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81f85627-f679-4616-9ac1-16be8742c578 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:11.801543 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81f85627-f679-4616-9ac1-16be8742c578 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:11.875619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-bed0fc1c-9436-4fc3-a812-38eee93150a9 req-2e710725-3d9d-4af8-8eda-e90522a60c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c741ad6-9157-4ba5-95bd-eeb9f72f6604", "name": "network-vif-deleted", "tag": "58699787-5d74-4aaa-912a-e7264f21e0ca"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:43:11.877987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:43:11.877987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:43:11.886724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-bed0fc1c-9436-4fc3-a812-38eee93150a9 req-2e710725-3d9d-4af8-8eda-e90522a60c79 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:11.887190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-bed0fc1c-9436-4fc3-a812-38eee93150a9 req-2e710725-3d9d-4af8-8eda-e90522a60c79 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:11.903114 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-bed0fc1c-9436-4fc3-a812-38eee93150a9 req-2e710725-3d9d-4af8-8eda-e90522a60c79 service nova] Creating event network-vif-deleted:58699787-5d74-4aaa-912a-e7264f21e0ca for instance 7c741ad6-9157-4ba5-95bd-eeb9f72f6604 on hv-cinder-82002 Dec 15 16:43:11.908825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-bed0fc1c-9436-4fc3-a812-38eee93150a9 req-2e710725-3d9d-4af8-8eda-e90522a60c79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037303 Dec 15 16:43:11.909871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1192/2171] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:43:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:43:11.972819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-81f85627-f679-4616-9ac1-16be8742c578 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:11.980720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-81f85627-f679-4616-9ac1-16be8742c578 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.192368 Dec 15 16:43:11.981281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 980/2172] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:11 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:12.123776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:12.125366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:12.135712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:12.136417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:12.137718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:12.138411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:12.169796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:12.170389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:12.170634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lazy-loading 'fault' on Instance uuid 7c741ad6-9157-4ba5-95bd-eeb9f72f6604 {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:43:12.214889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2f7c8ccd2541babbb2eb7503463cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370dfab4258d483f94f4dc1cbce64954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:12.222774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e1219b4f-8e09-44a7-8d46-524897354265 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 200 len: 1307 microversion: 2.1 time: 0.105901 Dec 15 16:43:12.223340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1193/2173] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:12 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:12.331565 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:12.332172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:12.338103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:12.338558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:12.339410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:12.339921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:12.476268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:12.484755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:12.486249 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:12.487434 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-80ec174a-94d0-41e0-862d-4cc6fc2db4c7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160098 Dec 15 16:43:12.488003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 981/2174] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:12.998127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5906b613-8c08-48b2-a77b-bed4da4ea13d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:12.998743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5906b613-8c08-48b2-a77b-bed4da4ea13d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:13.005148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5906b613-8c08-48b2-a77b-bed4da4ea13d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:13.005604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5906b613-8c08-48b2-a77b-bed4da4ea13d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:13.006380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5906b613-8c08-48b2-a77b-bed4da4ea13d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:13.006823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5906b613-8c08-48b2-a77b-bed4da4ea13d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:13.137559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5906b613-8c08-48b2-a77b-bed4da4ea13d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:13.146093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5906b613-8c08-48b2-a77b-bed4da4ea13d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.151698 Dec 15 16:43:13.146677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1194/2175] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:12 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:13.243484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aaceead3-fea7-4e65-8a7b-7a539e4c9ef0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:13.244362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aaceead3-fea7-4e65-8a7b-7a539e4c9ef0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] [instance: 7c741ad6-9157-4ba5-95bd-eeb9f72f6604] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:13.252911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aaceead3-fea7-4e65-8a7b-7a539e4c9ef0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:13.253359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aaceead3-fea7-4e65-8a7b-7a539e4c9ef0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:13.254143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aaceead3-fea7-4e65-8a7b-7a539e4c9ef0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:13.254582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aaceead3-fea7-4e65-8a7b-7a539e4c9ef0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:13.268833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-aaceead3-fea7-4e65-8a7b-7a539e4c9ef0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] HTTP exception thrown: Instance 7c741ad6-9157-4ba5-95bd-eeb9f72f6604 could not be found. Dec 15 16:43:13.269457 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aaceead3-fea7-4e65-8a7b-7a539e4c9ef0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] Returning 404 to user: Instance 7c741ad6-9157-4ba5-95bd-eeb9f72f6604 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:43:13.270310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aaceead3-fea7-4e65-8a7b-7a539e4c9ef0 tempest-AttachVolumeNegativeTest-2012111739 tempest-AttachVolumeNegativeTest-2012111739-project] 10.222.0.30 "GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604" status: 404 len: 111 microversion: 2.1 time: 0.033100 Dec 15 16:43:13.270855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 982/2176] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:13 2021] GET /compute/v2.1/servers/7c741ad6-9157-4ba5-95bd-eeb9f72f6604 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:43:13.506374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:13.506962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:13.513679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:13.514144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:13.515068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:13.515491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:13.719576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:13.728201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:13.729688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:13.730861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c9bf54ca-1c30-4816-a68a-b9235b0b3ec4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.228432 Dec 15 16:43:13.731480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1195/2177] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:13 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:14.167255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2d662c7a-e276-4c58-8a00-d48c17bd2b5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:14.167976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2d662c7a-e276-4c58-8a00-d48c17bd2b5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:14.174650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d662c7a-e276-4c58-8a00-d48c17bd2b5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:14.175203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d662c7a-e276-4c58-8a00-d48c17bd2b5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:14.176068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d662c7a-e276-4c58-8a00-d48c17bd2b5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:14.176551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2d662c7a-e276-4c58-8a00-d48c17bd2b5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:14.325695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2d662c7a-e276-4c58-8a00-d48c17bd2b5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:14.333623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2d662c7a-e276-4c58-8a00-d48c17bd2b5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170321 Dec 15 16:43:14.334195 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 983/2178] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:14 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:14.749912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:14.750590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:14.757618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:14.758122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:14.758989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:14.759434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:14.896746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:14.905863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:14.907398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:14.908592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-761ad84f-8b4c-4b5d-b1fd-2ddabb1239db tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.163353 Dec 15 16:43:14.909156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1196/2179] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:15.352050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a518da34-6510-4cb4-9e01-2dbeef0c998d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:15.352646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a518da34-6510-4cb4-9e01-2dbeef0c998d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:15.361788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a518da34-6510-4cb4-9e01-2dbeef0c998d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:15.362405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a518da34-6510-4cb4-9e01-2dbeef0c998d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:15.363520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a518da34-6510-4cb4-9e01-2dbeef0c998d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:15.364423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a518da34-6510-4cb4-9e01-2dbeef0c998d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:15.496615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a518da34-6510-4cb4-9e01-2dbeef0c998d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:15.504913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a518da34-6510-4cb4-9e01-2dbeef0c998d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.156611 Dec 15 16:43:15.505462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 984/2180] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:15 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:15.928070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:15.928757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:15.936352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:15.936831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:15.937716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:15.938150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:16.069485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:16.081605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:16.083095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:16.084251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-94132815-3e97-47ae-98ee-095ead22eb3c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160529 Dec 15 16:43:16.084830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1197/2181] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:43:16.527218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-439e7224-875f-425b-a3d6-2eab59f4642f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:16.528084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-439e7224-875f-425b-a3d6-2eab59f4642f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:16.538927 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-439e7224-875f-425b-a3d6-2eab59f4642f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:16.539677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-439e7224-875f-425b-a3d6-2eab59f4642f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:16.541039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-439e7224-875f-425b-a3d6-2eab59f4642f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:16.541764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-439e7224-875f-425b-a3d6-2eab59f4642f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:16.680125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-439e7224-875f-425b-a3d6-2eab59f4642f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:16.688419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-439e7224-875f-425b-a3d6-2eab59f4642f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167576 Dec 15 16:43:16.688986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 985/2182] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:16 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:17.104762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:17.105477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:17.113060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:17.113509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:17.114293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:17.114739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:17.244149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:17.256957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:17.259264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:17.260781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-882dff65-a3c0-429f-ac33-0be5e144cab8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160844 Dec 15 16:43:17.261546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1198/2183] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:17.710406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0128807a-4014-411c-8f90-1bdb65947770 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:17.711389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0128807a-4014-411c-8f90-1bdb65947770 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:17.721465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0128807a-4014-411c-8f90-1bdb65947770 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:17.721916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0128807a-4014-411c-8f90-1bdb65947770 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:17.722700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0128807a-4014-411c-8f90-1bdb65947770 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:17.723133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0128807a-4014-411c-8f90-1bdb65947770 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:17.870812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0128807a-4014-411c-8f90-1bdb65947770 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:17.884948 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0128807a-4014-411c-8f90-1bdb65947770 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.180678 Dec 15 16:43:17.885753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 986/2184] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:17 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:18.279942 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:18.281427 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:18.288705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:18.289244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:18.290386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:18.290812 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:18.428585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:18.437095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:18.438768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:18.440051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b51e9d58-6b83-4a51-854e-82206235e3b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.164418 Dec 15 16:43:18.440727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1199/2185] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:18.906559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e405d89f-7c4c-47e5-9ea2-6e3995bcd1d8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:18.907610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e405d89f-7c4c-47e5-9ea2-6e3995bcd1d8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:18.914248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e405d89f-7c4c-47e5-9ea2-6e3995bcd1d8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:18.914700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e405d89f-7c4c-47e5-9ea2-6e3995bcd1d8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:18.915504 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e405d89f-7c4c-47e5-9ea2-6e3995bcd1d8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:18.915910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e405d89f-7c4c-47e5-9ea2-6e3995bcd1d8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:19.053259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e405d89f-7c4c-47e5-9ea2-6e3995bcd1d8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:19.061756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e405d89f-7c4c-47e5-9ea2-6e3995bcd1d8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161489 Dec 15 16:43:19.062337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 987/2186] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:18 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:19.464544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:19.465632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:19.478244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:19.478244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:19.479534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:19.480288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:19.618718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:19.627507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:19.629002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:19.630144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3d7a3034-25ac-4b70-962a-ae0969c548b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171966 Dec 15 16:43:19.630698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1200/2187] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:19 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:20.081441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7f09abdc-b948-4425-82d0-e2f5d3a4ba11 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:20.082063 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7f09abdc-b948-4425-82d0-e2f5d3a4ba11 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:20.088906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f09abdc-b948-4425-82d0-e2f5d3a4ba11 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:20.089368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f09abdc-b948-4425-82d0-e2f5d3a4ba11 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:20.090149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f09abdc-b948-4425-82d0-e2f5d3a4ba11 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:20.090585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7f09abdc-b948-4425-82d0-e2f5d3a4ba11 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:20.232210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7f09abdc-b948-4425-82d0-e2f5d3a4ba11 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:20.240522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7f09abdc-b948-4425-82d0-e2f5d3a4ba11 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163932 Dec 15 16:43:20.241125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 988/2188] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:20 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:20.653644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:20.654252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:20.660614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:20.661079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:20.661848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:20.662274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:20.795924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:20.805238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:20.806725 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:20.807903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-83baa071-3d28-4fac-ae0e-b35798737985 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.158026 Dec 15 16:43:20.808464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1201/2189] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:21.261866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-de729aef-bba0-40d4-a5a1-68380657fbdb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:21.262926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-de729aef-bba0-40d4-a5a1-68380657fbdb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:21.273698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de729aef-bba0-40d4-a5a1-68380657fbdb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:21.274428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de729aef-bba0-40d4-a5a1-68380657fbdb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:21.275752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de729aef-bba0-40d4-a5a1-68380657fbdb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:21.276489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-de729aef-bba0-40d4-a5a1-68380657fbdb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:21.408562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-de729aef-bba0-40d4-a5a1-68380657fbdb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:21.417168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-de729aef-bba0-40d4-a5a1-68380657fbdb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161780 Dec 15 16:43:21.417740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 989/2190] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:21 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:21.830865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:21.831882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:21.842836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:21.843868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:21.845239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:21.845964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:21.998013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:22.007163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:22.008840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:22.009998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4eb7fe9b-2b71-4752-836c-75a636e89f5f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.185966 Dec 15 16:43:22.010558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1202/2191] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:22.437489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-91d9f1d0-9d3c-4ac2-b9ab-5cfa83410bdf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:22.438485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-91d9f1d0-9d3c-4ac2-b9ab-5cfa83410bdf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:22.449337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91d9f1d0-9d3c-4ac2-b9ab-5cfa83410bdf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:22.450092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91d9f1d0-9d3c-4ac2-b9ab-5cfa83410bdf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:22.451390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91d9f1d0-9d3c-4ac2-b9ab-5cfa83410bdf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:22.452113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-91d9f1d0-9d3c-4ac2-b9ab-5cfa83410bdf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:22.590431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-91d9f1d0-9d3c-4ac2-b9ab-5cfa83410bdf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:22.599513 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-91d9f1d0-9d3c-4ac2-b9ab-5cfa83410bdf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168252 Dec 15 16:43:22.600090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 990/2192] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:22 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:23.029529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:23.030134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:23.036998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:23.037450 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:23.038242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:23.038679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:23.198765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:23.207144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:23.208643 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:23.209786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d9404136-f903-4f6b-90a3-fa2d039b7f11 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.184129 Dec 15 16:43:23.210343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1203/2193] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:23.622211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-53c399ee-df68-4f44-867e-bbab0352e92f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:23.623167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-53c399ee-df68-4f44-867e-bbab0352e92f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:23.631562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53c399ee-df68-4f44-867e-bbab0352e92f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:23.632018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53c399ee-df68-4f44-867e-bbab0352e92f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:23.632841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53c399ee-df68-4f44-867e-bbab0352e92f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:23.633278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-53c399ee-df68-4f44-867e-bbab0352e92f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:24.025367 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-53c399ee-df68-4f44-867e-bbab0352e92f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:24.033236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-53c399ee-df68-4f44-867e-bbab0352e92f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.417789 Dec 15 16:43:24.033809 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 991/2194] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:23 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:24.232359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:24.233303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:24.243965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:24.244782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:24.246054 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:24.246781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:24.389748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:24.402252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:24.404623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:24.406285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2643208f-8924-4b52-bc0b-f6dc7c2f3957 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180062 Dec 15 16:43:24.407052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1204/2195] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:25.059694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aef9e688-c7bd-481e-b32b-6197b10a1aaf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:25.060304 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aef9e688-c7bd-481e-b32b-6197b10a1aaf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:25.069005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aef9e688-c7bd-481e-b32b-6197b10a1aaf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:25.069453 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aef9e688-c7bd-481e-b32b-6197b10a1aaf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:25.070244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aef9e688-c7bd-481e-b32b-6197b10a1aaf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:25.070681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aef9e688-c7bd-481e-b32b-6197b10a1aaf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:25.216032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aef9e688-c7bd-481e-b32b-6197b10a1aaf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:25.225137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aef9e688-c7bd-481e-b32b-6197b10a1aaf tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.171418 Dec 15 16:43:25.225683 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 992/2196] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:25 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:25.428155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:25.428775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:25.435652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:25.436126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:25.436975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:25.437416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:25.568922 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:25.578040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:25.579536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:25.580727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d105089d-96e4-42ba-8591-421bd14afd0a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.157579 Dec 15 16:43:25.581310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1205/2197] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:26.246440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d7649550-3d25-42fa-8bb4-b0866edc0485 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:26.247496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d7649550-3d25-42fa-8bb4-b0866edc0485 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:26.258478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7649550-3d25-42fa-8bb4-b0866edc0485 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:26.259215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7649550-3d25-42fa-8bb4-b0866edc0485 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:26.260496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7649550-3d25-42fa-8bb4-b0866edc0485 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:26.261247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7649550-3d25-42fa-8bb4-b0866edc0485 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:26.405150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d7649550-3d25-42fa-8bb4-b0866edc0485 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:26.413506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d7649550-3d25-42fa-8bb4-b0866edc0485 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.173241 Dec 15 16:43:26.414077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 993/2198] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:26 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:26.603559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:26.604540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:26.615233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:26.615961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:26.617275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:26.617998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:26.756057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:26.764453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:26.765944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:26.767092 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5ffe53e5-4975-41d7-80f5-25305455598e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.169972 Dec 15 16:43:26.767659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1206/2199] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:26 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:27.434789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ab7c4ece-24b2-4b52-9571-704257e6195f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:27.435779 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ab7c4ece-24b2-4b52-9571-704257e6195f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:27.446494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab7c4ece-24b2-4b52-9571-704257e6195f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:27.447213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab7c4ece-24b2-4b52-9571-704257e6195f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:27.448514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab7c4ece-24b2-4b52-9571-704257e6195f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:27.449247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab7c4ece-24b2-4b52-9571-704257e6195f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:27.585957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ab7c4ece-24b2-4b52-9571-704257e6195f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:27.594658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ab7c4ece-24b2-4b52-9571-704257e6195f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166168 Dec 15 16:43:27.595244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 994/2200] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:27 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:27.789988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:27.790810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:27.799410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:27.800005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:27.801081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:27.801666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:27.942439 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:27.950962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:27.952460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:27.953628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b5dd01a0-04f8-4faa-9440-97a0dbd94452 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.169794 Dec 15 16:43:27.954181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1207/2201] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:28.615856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-56333d2a-4d78-41ec-83c4-05ab42475822 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:28.616870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-56333d2a-4d78-41ec-83c4-05ab42475822 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:28.627615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56333d2a-4d78-41ec-83c4-05ab42475822 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:28.628362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56333d2a-4d78-41ec-83c4-05ab42475822 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:28.629732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56333d2a-4d78-41ec-83c4-05ab42475822 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:28.630460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-56333d2a-4d78-41ec-83c4-05ab42475822 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:28.762578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-56333d2a-4d78-41ec-83c4-05ab42475822 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:28.770847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-56333d2a-4d78-41ec-83c4-05ab42475822 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161238 Dec 15 16:43:28.771430 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 995/2202] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:28 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:28.975728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:28.976647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:28.988607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:28.989352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:28.990633 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:28.991353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:29.127190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:29.140664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:29.142863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:29.144690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eb08634d-01ce-487f-ad0a-2711212205d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175137 Dec 15 16:43:29.145458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1208/2203] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:29.792470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3354e7de-e24e-4092-a6a6-f881d1422883 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:29.793463 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3354e7de-e24e-4092-a6a6-f881d1422883 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:29.803876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3354e7de-e24e-4092-a6a6-f881d1422883 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:29.804697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3354e7de-e24e-4092-a6a6-f881d1422883 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:29.805955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3354e7de-e24e-4092-a6a6-f881d1422883 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:29.806574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3354e7de-e24e-4092-a6a6-f881d1422883 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:29.952352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3354e7de-e24e-4092-a6a6-f881d1422883 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:29.965997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3354e7de-e24e-4092-a6a6-f881d1422883 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.179503 Dec 15 16:43:29.966892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 996/2204] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:29 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:30.165610 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:30.166234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:30.173766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:30.174261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:30.175112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:30.175589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:30.313456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:30.322223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:30.323726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:30.325056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-466ca41b-2e08-43cc-8fae-42ab5e3756ce tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.164845 Dec 15 16:43:30.325850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1209/2205] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:30.992155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bfb91d98-b16c-453d-8a57-d9af7ce9b1e6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:30.993445 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bfb91d98-b16c-453d-8a57-d9af7ce9b1e6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:31.004186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bfb91d98-b16c-453d-8a57-d9af7ce9b1e6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:31.004979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bfb91d98-b16c-453d-8a57-d9af7ce9b1e6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:31.006291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bfb91d98-b16c-453d-8a57-d9af7ce9b1e6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:31.007073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bfb91d98-b16c-453d-8a57-d9af7ce9b1e6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:31.150382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bfb91d98-b16c-453d-8a57-d9af7ce9b1e6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:31.158312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bfb91d98-b16c-453d-8a57-d9af7ce9b1e6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172516 Dec 15 16:43:31.158879 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 997/2206] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:30 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:31.344120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:31.344737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:31.351222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:31.351679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:31.352573 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:31.353032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:31.488508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:31.501768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:31.503648 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:31.505454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1092b5df-d997-4e49-8abb-e987dbbb7ba8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165442 Dec 15 16:43:31.506159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1210/2207] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:32.175054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-922f11e8-c41c-4df1-afe5-8bb9c0b14e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:32.175673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-922f11e8-c41c-4df1-afe5-8bb9c0b14e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:32.182289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-922f11e8-c41c-4df1-afe5-8bb9c0b14e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:32.182739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-922f11e8-c41c-4df1-afe5-8bb9c0b14e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:32.183536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-922f11e8-c41c-4df1-afe5-8bb9c0b14e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:32.183966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-922f11e8-c41c-4df1-afe5-8bb9c0b14e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:32.320468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-922f11e8-c41c-4df1-afe5-8bb9c0b14e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:32.328953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-922f11e8-c41c-4df1-afe5-8bb9c0b14e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.157590 Dec 15 16:43:32.329520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 998/2208] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:32 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:32.525962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:32.526534 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:32.533535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:32.533985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:32.534760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:32.535191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:32.678582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:32.687276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:32.688803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:32.689962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-903c57d5-2fbb-45d6-97d6-f6be1cfec01f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.169377 Dec 15 16:43:32.690535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1211/2209] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:32 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:33.350605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1c5e3c08-3d26-405e-a0e6-b73ec7103994 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:33.351617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1c5e3c08-3d26-405e-a0e6-b73ec7103994 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:33.362423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c5e3c08-3d26-405e-a0e6-b73ec7103994 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:33.363174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c5e3c08-3d26-405e-a0e6-b73ec7103994 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:33.364500 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c5e3c08-3d26-405e-a0e6-b73ec7103994 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:33.365262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c5e3c08-3d26-405e-a0e6-b73ec7103994 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:33.501628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1c5e3c08-3d26-405e-a0e6-b73ec7103994 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:33.509816 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1c5e3c08-3d26-405e-a0e6-b73ec7103994 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.165514 Dec 15 16:43:33.510509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 999/2210] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:33 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:33.708592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:33.709143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:33.715148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:33.715592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:33.716363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:33.716965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:33.860786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:33.869645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:33.871104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:33.872255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dbcb57a7-2d2f-423f-8587-214df15b9e26 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.167514 Dec 15 16:43:33.872843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1212/2211] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:34.530557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a9685f18-aa45-41ee-aa8b-4ab7dff3aecb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:34.531133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a9685f18-aa45-41ee-aa8b-4ab7dff3aecb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:34.541397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9685f18-aa45-41ee-aa8b-4ab7dff3aecb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:34.541804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9685f18-aa45-41ee-aa8b-4ab7dff3aecb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:34.542596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9685f18-aa45-41ee-aa8b-4ab7dff3aecb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:34.543028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a9685f18-aa45-41ee-aa8b-4ab7dff3aecb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:34.675707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a9685f18-aa45-41ee-aa8b-4ab7dff3aecb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:34.688485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a9685f18-aa45-41ee-aa8b-4ab7dff3aecb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164160 Dec 15 16:43:34.689314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1000/2212] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:34 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:34.894948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:34.895850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:34.904106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:34.904588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:34.905357 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:34.905786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:35.058399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:35.067426 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:35.068949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:35.070105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6c9fe69f-55f5-4b97-816d-e4f6375bdef1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.181532 Dec 15 16:43:35.070638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1213/2213] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:35.708767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3dd68911-f855-4a71-a30b-28d90ed58ca9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:35.709382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3dd68911-f855-4a71-a30b-28d90ed58ca9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:35.715907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3dd68911-f855-4a71-a30b-28d90ed58ca9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:35.716362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3dd68911-f855-4a71-a30b-28d90ed58ca9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:35.717528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3dd68911-f855-4a71-a30b-28d90ed58ca9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:35.717961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3dd68911-f855-4a71-a30b-28d90ed58ca9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:35.859721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3dd68911-f855-4a71-a30b-28d90ed58ca9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:35.868051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3dd68911-f855-4a71-a30b-28d90ed58ca9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.162968 Dec 15 16:43:35.868723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1001/2214] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:35 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:36.090886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:36.091868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:36.101751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:36.102405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:36.103613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:36.103989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:36.248687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:36.257735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:36.259322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:36.260478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a92f936c-955c-468d-bc57-465559591ccb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.174739 Dec 15 16:43:36.261054 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1214/2215] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:36.889668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-84d88bb0-fabc-4525-9eb2-8b736ed1846f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:36.890613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-84d88bb0-fabc-4525-9eb2-8b736ed1846f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:36.901383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d88bb0-fabc-4525-9eb2-8b736ed1846f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:36.902118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d88bb0-fabc-4525-9eb2-8b736ed1846f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:36.903396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d88bb0-fabc-4525-9eb2-8b736ed1846f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:36.904107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-84d88bb0-fabc-4525-9eb2-8b736ed1846f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:37.042853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-84d88bb0-fabc-4525-9eb2-8b736ed1846f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:37.050986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-84d88bb0-fabc-4525-9eb2-8b736ed1846f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167928 Dec 15 16:43:37.051542 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1002/2216] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:36 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:37.283268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:37.284130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:37.294891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:37.295651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:37.297015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:37.297850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:37.438420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:37.447501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:37.449060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:37.450266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0fbd7b56-40ec-409d-806d-45f371397708 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.173694 Dec 15 16:43:37.450842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1215/2217] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:43:38.072285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-82dde4fa-2e85-4c9a-a41a-f5bc7d038fd3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:38.073308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-82dde4fa-2e85-4c9a-a41a-f5bc7d038fd3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:38.084057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82dde4fa-2e85-4c9a-a41a-f5bc7d038fd3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:38.084873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82dde4fa-2e85-4c9a-a41a-f5bc7d038fd3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:38.086186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82dde4fa-2e85-4c9a-a41a-f5bc7d038fd3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:38.086906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-82dde4fa-2e85-4c9a-a41a-f5bc7d038fd3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:38.229826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-82dde4fa-2e85-4c9a-a41a-f5bc7d038fd3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:38.238318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-82dde4fa-2e85-4c9a-a41a-f5bc7d038fd3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172187 Dec 15 16:43:38.238868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1003/2218] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:38 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:38.472708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:38.473299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:38.481611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:38.482061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:38.482851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:38.483279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:38.618234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:38.630057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:38.633014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:38.634930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fbdf2978-a7d3-4ee4-83a5-4b7944dc1705 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.167716 Dec 15 16:43:38.635520 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1216/2219] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:38 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:39.256830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7d6586cd-d808-412a-a9f7-8fdd126681d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:39.257454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7d6586cd-d808-412a-a9f7-8fdd126681d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:39.264393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d6586cd-d808-412a-a9f7-8fdd126681d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:39.264877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d6586cd-d808-412a-a9f7-8fdd126681d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:39.265695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d6586cd-d808-412a-a9f7-8fdd126681d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:39.266130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d6586cd-d808-412a-a9f7-8fdd126681d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:39.403992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7d6586cd-d808-412a-a9f7-8fdd126681d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:39.412536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7d6586cd-d808-412a-a9f7-8fdd126681d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.159416 Dec 15 16:43:39.413119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1004/2220] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:39 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:39.653696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:39.654278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:39.661021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:39.661479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:39.662245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:39.662673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:39.800595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:39.810509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:39.811965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:39.813146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d3c37499-5c90-44f5-8bda-d02f93051703 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.163366 Dec 15 16:43:39.813701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1217/2221] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:40.439450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4692cdfe-4edf-413a-b332-f51a87597a4f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:40.440484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4692cdfe-4edf-413a-b332-f51a87597a4f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:40.449702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4692cdfe-4edf-413a-b332-f51a87597a4f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:40.450147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4692cdfe-4edf-413a-b332-f51a87597a4f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:40.450918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4692cdfe-4edf-413a-b332-f51a87597a4f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:40.451345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4692cdfe-4edf-413a-b332-f51a87597a4f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:40.583699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4692cdfe-4edf-413a-b332-f51a87597a4f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:40.596322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4692cdfe-4edf-413a-b332-f51a87597a4f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.162763 Dec 15 16:43:40.597235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1005/2222] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:40 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:40.835253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:40.836215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:40.843789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:40.844258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:40.845085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:40.845513 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:40.998118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:41.007434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:41.009026 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:41.010570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d8cd0860-e3c6-4f1d-b213-7d3aa4847ef7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.181304 Dec 15 16:43:41.011135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1218/2223] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:41.618380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2485cbc5-e1d8-405b-b2ca-f6b6b99b7e6e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:41.619571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2485cbc5-e1d8-405b-b2ca-f6b6b99b7e6e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:41.630444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2485cbc5-e1d8-405b-b2ca-f6b6b99b7e6e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:41.631180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2485cbc5-e1d8-405b-b2ca-f6b6b99b7e6e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:41.632497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2485cbc5-e1d8-405b-b2ca-f6b6b99b7e6e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:41.633225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2485cbc5-e1d8-405b-b2ca-f6b6b99b7e6e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:41.779316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2485cbc5-e1d8-405b-b2ca-f6b6b99b7e6e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:41.788561 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2485cbc5-e1d8-405b-b2ca-f6b6b99b7e6e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.176477 Dec 15 16:43:41.789187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1006/2224] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:41 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:42.030508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:42.031077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:42.037761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:42.038209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:42.038989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:42.039507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:42.173581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:42.182747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:42.184210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:42.185397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-95026fea-db8e-479c-8dd6-252ec4e9277b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.158957 Dec 15 16:43:42.185926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1219/2225] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:42.806018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a959d7fc-cbed-4f85-aea4-cf7cb4a5d18a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:42.806680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a959d7fc-cbed-4f85-aea4-cf7cb4a5d18a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:42.814404 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a959d7fc-cbed-4f85-aea4-cf7cb4a5d18a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:42.814886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a959d7fc-cbed-4f85-aea4-cf7cb4a5d18a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:42.815992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a959d7fc-cbed-4f85-aea4-cf7cb4a5d18a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:42.816548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a959d7fc-cbed-4f85-aea4-cf7cb4a5d18a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:42.957741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a959d7fc-cbed-4f85-aea4-cf7cb4a5d18a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:42.967520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a959d7fc-cbed-4f85-aea4-cf7cb4a5d18a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164854 Dec 15 16:43:42.968095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1007/2226] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:42 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:43.205989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:43.206630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:43.216325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:43.216987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:43.218461 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:43.219029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:43.358922 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:43.371776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:43.373964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:43.375708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6d4118aa-d53a-4242-8d74-28c55d7cd5e9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175427 Dec 15 16:43:43.376581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1220/2227] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:43.988746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-66aa6845-a5a1-4b81-b362-e5a7beab19f8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:43.989722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-66aa6845-a5a1-4b81-b362-e5a7beab19f8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:44.000605 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-66aa6845-a5a1-4b81-b362-e5a7beab19f8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:44.001339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-66aa6845-a5a1-4b81-b362-e5a7beab19f8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:44.002681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-66aa6845-a5a1-4b81-b362-e5a7beab19f8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:44.003402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-66aa6845-a5a1-4b81-b362-e5a7beab19f8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:44.163884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-66aa6845-a5a1-4b81-b362-e5a7beab19f8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:44.176369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-66aa6845-a5a1-4b81-b362-e5a7beab19f8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.193570 Dec 15 16:43:44.177217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1008/2228] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:43 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:44.398364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:44.399224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:44.407047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:44.407502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:44.408287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:44.408756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:44.543110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:44.551627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:44.553153 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:44.554312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-947e9411-9aa3-4047-9dba-282a459d20d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.162314 Dec 15 16:43:44.554877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1221/2229] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:44 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:45.200795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ed381f43-1723-4af1-92e0-776288f93bd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:45.201738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ed381f43-1723-4af1-92e0-776288f93bd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:45.213258 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed381f43-1723-4af1-92e0-776288f93bd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:45.214004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed381f43-1723-4af1-92e0-776288f93bd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:45.215332 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed381f43-1723-4af1-92e0-776288f93bd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:45.215774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ed381f43-1723-4af1-92e0-776288f93bd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:45.356554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ed381f43-1723-4af1-92e0-776288f93bd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:45.364497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ed381f43-1723-4af1-92e0-776288f93bd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170560 Dec 15 16:43:45.365072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1009/2230] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:45 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:45.576348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:45.577097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:45.585386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:45.585952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:45.586936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:45.587477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:45.730676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:45.739632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:45.741189 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:45.742343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-505ff214-5be8-474d-b2e4-f563f9d0f947 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172015 Dec 15 16:43:45.742904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1222/2231] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:46.381832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-123691d1-56b5-4d02-a243-eee9de0f86ef tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:46.382378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-123691d1-56b5-4d02-a243-eee9de0f86ef tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:46.388922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-123691d1-56b5-4d02-a243-eee9de0f86ef tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:46.389363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-123691d1-56b5-4d02-a243-eee9de0f86ef tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:46.390124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-123691d1-56b5-4d02-a243-eee9de0f86ef tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:46.390562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-123691d1-56b5-4d02-a243-eee9de0f86ef tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:46.533030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-123691d1-56b5-4d02-a243-eee9de0f86ef tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:46.541340 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-123691d1-56b5-4d02-a243-eee9de0f86ef tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163210 Dec 15 16:43:46.541899 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1010/2232] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:46 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:46.765558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:46.766193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:46.773202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:46.773675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:46.774484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:46.774945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:46.910102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:46.918962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:46.920728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:46.921887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-69517768-c491-4bc7-b117-e4c4afd5a1cb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.162299 Dec 15 16:43:46.922446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1223/2233] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:47.561070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-addd7caa-e253-4659-a291-b9d6a178f42c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:47.561700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-addd7caa-e253-4659-a291-b9d6a178f42c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:47.569521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-addd7caa-e253-4659-a291-b9d6a178f42c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:47.569971 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-addd7caa-e253-4659-a291-b9d6a178f42c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:47.570762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-addd7caa-e253-4659-a291-b9d6a178f42c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:47.571188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-addd7caa-e253-4659-a291-b9d6a178f42c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:47.734970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-addd7caa-e253-4659-a291-b9d6a178f42c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:47.743933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-addd7caa-e253-4659-a291-b9d6a178f42c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.187757 Dec 15 16:43:47.744806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1011/2234] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:47 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:47.941791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:47.942398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:47.949071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:47.949511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:47.950317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:47.950748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:48.105567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:48.114969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:48.116463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:48.117659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-564eba96-31bf-405e-b4ce-528a26f64e5b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.181331 Dec 15 16:43:48.118220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1224/2235] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:43:48.765180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e4938221-88bb-498c-a4e8-bf0cc062d40f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:48.766091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e4938221-88bb-498c-a4e8-bf0cc062d40f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:48.776840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4938221-88bb-498c-a4e8-bf0cc062d40f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:48.777580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4938221-88bb-498c-a4e8-bf0cc062d40f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:48.778858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4938221-88bb-498c-a4e8-bf0cc062d40f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:48.779646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e4938221-88bb-498c-a4e8-bf0cc062d40f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:48.915247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e4938221-88bb-498c-a4e8-bf0cc062d40f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:48.924797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e4938221-88bb-498c-a4e8-bf0cc062d40f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166366 Dec 15 16:43:48.925413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1012/2236] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:48 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:49.139678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:49.140291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:49.146907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:49.147369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:49.148144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:49.148620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:49.287227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:49.299056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:49.300598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:49.301756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f2cb57b6-911f-4650-bc58-9f43c7ba1278 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166670 Dec 15 16:43:49.302328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1225/2237] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:49.945589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-235ba493-ee86-4f33-9cf3-dd97d041e258 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:49.946436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-235ba493-ee86-4f33-9cf3-dd97d041e258 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:49.955284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-235ba493-ee86-4f33-9cf3-dd97d041e258 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:49.955734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-235ba493-ee86-4f33-9cf3-dd97d041e258 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:49.956552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-235ba493-ee86-4f33-9cf3-dd97d041e258 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:49.956987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-235ba493-ee86-4f33-9cf3-dd97d041e258 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:50.107154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-235ba493-ee86-4f33-9cf3-dd97d041e258 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:50.118591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-235ba493-ee86-4f33-9cf3-dd97d041e258 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.179080 Dec 15 16:43:50.119362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1013/2238] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:49 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:50.323958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:50.324996 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:50.336096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:50.336899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:50.338193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:50.338924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:50.478184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:50.487278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:50.488783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:50.489935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-00054af9-91cb-45f6-8b48-19c504eadf36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172104 Dec 15 16:43:50.490498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1226/2239] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:50 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:51.136969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2f26922f-a8c8-462a-b61d-acac1f5adfdd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:51.137653 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2f26922f-a8c8-462a-b61d-acac1f5adfdd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:51.145991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f26922f-a8c8-462a-b61d-acac1f5adfdd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:51.146526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f26922f-a8c8-462a-b61d-acac1f5adfdd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:51.147424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f26922f-a8c8-462a-b61d-acac1f5adfdd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:51.147930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f26922f-a8c8-462a-b61d-acac1f5adfdd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:51.294138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2f26922f-a8c8-462a-b61d-acac1f5adfdd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:51.302680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2f26922f-a8c8-462a-b61d-acac1f5adfdd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170000 Dec 15 16:43:51.303259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1014/2240] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:51 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:51.515760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:51.516335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:51.523040 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:51.523487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:51.524250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:51.524724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:51.660562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:51.673923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:51.676166 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:51.678198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8ce6e85b-1cee-43d8-87e1-a75c6eafff8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166210 Dec 15 16:43:51.678984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1227/2241] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:52.319827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bd92a2d7-44e3-476b-9466-17dbfa5db2e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:52.320459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bd92a2d7-44e3-476b-9466-17dbfa5db2e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:52.326901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd92a2d7-44e3-476b-9466-17dbfa5db2e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:52.327923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd92a2d7-44e3-476b-9466-17dbfa5db2e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:52.328753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd92a2d7-44e3-476b-9466-17dbfa5db2e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:52.329189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bd92a2d7-44e3-476b-9466-17dbfa5db2e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:52.471854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bd92a2d7-44e3-476b-9466-17dbfa5db2e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:52.484695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bd92a2d7-44e3-476b-9466-17dbfa5db2e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168213 Dec 15 16:43:52.485620 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1015/2242] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:52 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:52.703050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:52.703746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:52.711598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:52.712121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:52.713061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:52.713563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:52.859607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:52.870815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:52.873196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:52.874836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c66b93b4-aac6-41c0-9215-976943fcffe1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.177885 Dec 15 16:43:52.875524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1228/2243] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:53.506241 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-afde9379-4667-4503-a865-1b5654f05735 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:53.507296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-afde9379-4667-4503-a865-1b5654f05735 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:53.516743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afde9379-4667-4503-a865-1b5654f05735 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:53.517187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afde9379-4667-4503-a865-1b5654f05735 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:53.517966 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afde9379-4667-4503-a865-1b5654f05735 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:53.518421 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afde9379-4667-4503-a865-1b5654f05735 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:53.663872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-afde9379-4667-4503-a865-1b5654f05735 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:53.672694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-afde9379-4667-4503-a865-1b5654f05735 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172704 Dec 15 16:43:53.673247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1016/2244] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:53 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:53.894047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:53.894646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:53.903197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:53.903836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:53.904953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:53.905391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:54.042236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:54.054810 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:54.057164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:54.058900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-529fd7d9-f940-4f03-a0b3-9b58347af6d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.168942 Dec 15 16:43:54.059681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1229/2245] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:54.694670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c09ea1b1-99b5-4773-896b-fe2b19df52e8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:54.695586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c09ea1b1-99b5-4773-896b-fe2b19df52e8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:54.706900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c09ea1b1-99b5-4773-896b-fe2b19df52e8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:54.707635 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c09ea1b1-99b5-4773-896b-fe2b19df52e8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:54.708970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c09ea1b1-99b5-4773-896b-fe2b19df52e8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:54.709690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c09ea1b1-99b5-4773-896b-fe2b19df52e8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:54.879970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c09ea1b1-99b5-4773-896b-fe2b19df52e8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:54.891282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c09ea1b1-99b5-4773-896b-fe2b19df52e8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.203466 Dec 15 16:43:54.891859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1017/2246] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:54 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:55.082655 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:55.083601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:55.094670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:55.095403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:55.096738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:55.097447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:55.252824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:55.265474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:55.266951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:55.268095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dde0de64-f8b9-4c6f-b1e4-c8e2a3cdd6e8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.191925 Dec 15 16:43:55.268690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1230/2247] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:55.912113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3e941902-61e2-435e-a37f-c6ec72dcaf81 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:55.913172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3e941902-61e2-435e-a37f-c6ec72dcaf81 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:55.923013 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3e941902-61e2-435e-a37f-c6ec72dcaf81 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:55.923462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3e941902-61e2-435e-a37f-c6ec72dcaf81 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:55.924246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3e941902-61e2-435e-a37f-c6ec72dcaf81 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:55.924714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3e941902-61e2-435e-a37f-c6ec72dcaf81 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:56.060104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3e941902-61e2-435e-a37f-c6ec72dcaf81 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:56.068423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3e941902-61e2-435e-a37f-c6ec72dcaf81 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.162609 Dec 15 16:43:56.069016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1018/2248] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:55 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:56.290817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:56.291633 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:56.302432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:56.303177 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:56.304514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:56.305280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:56.438886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:56.448259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:56.449748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:56.450917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f9a5a008-0333-425b-a549-c0a59c8c5c18 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.166618 Dec 15 16:43:56.451475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1231/2249] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:56 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:57.085529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4b12802d-dea3-493c-8f19-2f32510cb0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:57.086214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4b12802d-dea3-493c-8f19-2f32510cb0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:57.093232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b12802d-dea3-493c-8f19-2f32510cb0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:57.093786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b12802d-dea3-493c-8f19-2f32510cb0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:57.094555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b12802d-dea3-493c-8f19-2f32510cb0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:57.094981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b12802d-dea3-493c-8f19-2f32510cb0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:57.225176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4b12802d-dea3-493c-8f19-2f32510cb0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:57.233331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4b12802d-dea3-493c-8f19-2f32510cb0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.151523 Dec 15 16:43:57.234183 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1019/2250] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:57 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:57.473917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:57.474768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:57.485283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:57.485727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:57.486512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:57.486975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:57.628360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:57.637173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:57.638641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:57.639807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6e1c4f13-c760-4c81-95fc-9197bb84e5d7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172699 Dec 15 16:43:57.640392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1232/2251] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:58.251034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6311c1bc-f82b-4dde-b732-b77301adec27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:58.251629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6311c1bc-f82b-4dde-b732-b77301adec27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:58.258396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6311c1bc-f82b-4dde-b732-b77301adec27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:58.258837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6311c1bc-f82b-4dde-b732-b77301adec27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:58.259649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6311c1bc-f82b-4dde-b732-b77301adec27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:58.260090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6311c1bc-f82b-4dde-b732-b77301adec27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:58.393206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6311c1bc-f82b-4dde-b732-b77301adec27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:58.401764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6311c1bc-f82b-4dde-b732-b77301adec27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.154522 Dec 15 16:43:58.402337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1020/2252] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:58 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:58.661212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:58.662218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:58.672135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:58.672839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:58.673634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:58.674074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:58.803852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:58.812941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:58.814414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:58.815570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c5f27dc7-f327-477e-b098-79265247a141 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160822 Dec 15 16:43:58.816134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1233/2253] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:43:59.423080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dd741284-13d9-40d3-b6e8-04eb2e4cac6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:59.423939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dd741284-13d9-40d3-b6e8-04eb2e4cac6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:59.434529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd741284-13d9-40d3-b6e8-04eb2e4cac6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:59.435276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd741284-13d9-40d3-b6e8-04eb2e4cac6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:59.436606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd741284-13d9-40d3-b6e8-04eb2e4cac6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:59.437347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dd741284-13d9-40d3-b6e8-04eb2e4cac6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:59.577714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dd741284-13d9-40d3-b6e8-04eb2e4cac6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:59.586388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dd741284-13d9-40d3-b6e8-04eb2e4cac6f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169667 Dec 15 16:43:59.586972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1021/2254] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:43:59 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:43:59.842774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:43:59.843789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:43:59.854909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:59.855663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:59.857033 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:43:59.857952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:43:59.990588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:43:59.999079 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:00.000638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:00.001811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bc282703-a8dd-4ead-8942-9cd5f298c23b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165692 Dec 15 16:44:00.002718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1234/2255] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:43:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:00.607519 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-93f70bee-9450-4cc9-8e7f-862baf220658 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:00.608516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-93f70bee-9450-4cc9-8e7f-862baf220658 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:00.615416 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93f70bee-9450-4cc9-8e7f-862baf220658 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:00.615863 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93f70bee-9450-4cc9-8e7f-862baf220658 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:00.616676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93f70bee-9450-4cc9-8e7f-862baf220658 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:00.617105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-93f70bee-9450-4cc9-8e7f-862baf220658 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:00.754548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-93f70bee-9450-4cc9-8e7f-862baf220658 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:00.762531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-93f70bee-9450-4cc9-8e7f-862baf220658 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161169 Dec 15 16:44:00.774373 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1022/2256] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:00 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:01.028078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:01.028993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:01.036867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:01.037318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:01.038087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:01.038519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:01.180273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:01.191941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:01.193444 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:01.194588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-afe15ea3-6b8d-46d8-bb02-dbd21384e876 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172957 Dec 15 16:44:01.195151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1235/2257] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:01.784362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8b367a21-207b-4fbc-95da-e90306061517 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:01.784999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8b367a21-207b-4fbc-95da-e90306061517 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:01.792212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b367a21-207b-4fbc-95da-e90306061517 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:01.792740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b367a21-207b-4fbc-95da-e90306061517 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:01.793600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b367a21-207b-4fbc-95da-e90306061517 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:01.794072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8b367a21-207b-4fbc-95da-e90306061517 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:01.932281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8b367a21-207b-4fbc-95da-e90306061517 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:01.942490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8b367a21-207b-4fbc-95da-e90306061517 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163206 Dec 15 16:44:01.943084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1023/2258] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:01 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:02.216966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:02.218369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:02.229479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:02.230217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:02.231506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:02.232225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:02.384859 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:02.393848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:02.395331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:02.396518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d298da55-a2a8-41fb-8c7e-4ff3516aca9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.185769 Dec 15 16:44:02.397085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1236/2259] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:02 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:02.965393 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6f1e6091-09ca-4bce-9e68-167df6ef009e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:02.965999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6f1e6091-09ca-4bce-9e68-167df6ef009e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:02.976055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f1e6091-09ca-4bce-9e68-167df6ef009e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:02.976583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f1e6091-09ca-4bce-9e68-167df6ef009e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:02.977712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f1e6091-09ca-4bce-9e68-167df6ef009e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:02.978208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6f1e6091-09ca-4bce-9e68-167df6ef009e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:03.121486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6f1e6091-09ca-4bce-9e68-167df6ef009e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:03.130591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6f1e6091-09ca-4bce-9e68-167df6ef009e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.171051 Dec 15 16:44:03.131074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1024/2260] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:02 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:03.419539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:03.420397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:03.430919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:03.431689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:03.433036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:03.433782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:03.573086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:03.581904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:03.583371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:03.584555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e21c5856-a715-43d0-b75e-73ab00364cd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171599 Dec 15 16:44:03.585102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1237/2261] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:04.148390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f17d2848-86b0-4a7f-804c-465539678522 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:04.149198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f17d2848-86b0-4a7f-804c-465539678522 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:04.157038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f17d2848-86b0-4a7f-804c-465539678522 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:04.157546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f17d2848-86b0-4a7f-804c-465539678522 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:04.158482 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f17d2848-86b0-4a7f-804c-465539678522 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:04.158982 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f17d2848-86b0-4a7f-804c-465539678522 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:04.303933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f17d2848-86b0-4a7f-804c-465539678522 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:04.312519 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f17d2848-86b0-4a7f-804c-465539678522 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168672 Dec 15 16:44:04.313122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1025/2262] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:04 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:04.603364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:04.603959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:04.610591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:04.611064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:04.611844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:04.612285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:04.745250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:04.754157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:04.755640 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:04.756900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6597c545-bb86-492c-a954-57ba4a98c30b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.157253 Dec 15 16:44:04.757491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1238/2263] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:05.329572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2ee29db0-f893-44ed-9ca6-b7fffa0e1838 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:05.330194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2ee29db0-f893-44ed-9ca6-b7fffa0e1838 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:05.336978 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ee29db0-f893-44ed-9ca6-b7fffa0e1838 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:05.337444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ee29db0-f893-44ed-9ca6-b7fffa0e1838 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:05.338211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ee29db0-f893-44ed-9ca6-b7fffa0e1838 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:05.338672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ee29db0-f893-44ed-9ca6-b7fffa0e1838 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:05.477350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2ee29db0-f893-44ed-9ca6-b7fffa0e1838 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:05.489754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2ee29db0-f893-44ed-9ca6-b7fffa0e1838 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163822 Dec 15 16:44:05.490532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1026/2264] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:05 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:05.775073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:05.775651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:05.782443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:05.782885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:05.783689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:05.784117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:05.921185 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:05.929600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:05.931147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:05.932261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4c30ebfe-c3e8-4f80-a11e-44ba31d90775 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160908 Dec 15 16:44:05.932883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1239/2265] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:06.511141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2be9a0bb-9e15-47fe-8689-e1bc58c8952f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:06.512144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2be9a0bb-9e15-47fe-8689-e1bc58c8952f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:06.521532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2be9a0bb-9e15-47fe-8689-e1bc58c8952f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:06.521972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2be9a0bb-9e15-47fe-8689-e1bc58c8952f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:06.522756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2be9a0bb-9e15-47fe-8689-e1bc58c8952f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:06.523188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2be9a0bb-9e15-47fe-8689-e1bc58c8952f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:06.657559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2be9a0bb-9e15-47fe-8689-e1bc58c8952f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:06.665653 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2be9a0bb-9e15-47fe-8689-e1bc58c8952f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.160778 Dec 15 16:44:06.666232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1027/2266] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:06 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:44:06.953644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:06.954676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:06.966303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:06.967056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:06.968852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:06.969574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:07.111207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:07.121490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:07.123328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:07.124356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cf2b5b58-c798-422e-a499-997d255ad0d5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.176668 Dec 15 16:44:07.134888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1240/2267] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:07.687986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-01a33d76-a6b0-47db-8b36-acf92872393a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:07.689016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-01a33d76-a6b0-47db-8b36-acf92872393a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:07.697390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-01a33d76-a6b0-47db-8b36-acf92872393a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:07.697834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-01a33d76-a6b0-47db-8b36-acf92872393a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:07.698606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-01a33d76-a6b0-47db-8b36-acf92872393a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:07.699033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-01a33d76-a6b0-47db-8b36-acf92872393a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:07.853551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-01a33d76-a6b0-47db-8b36-acf92872393a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:07.861660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-01a33d76-a6b0-47db-8b36-acf92872393a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.179950 Dec 15 16:44:07.862221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1028/2268] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:07 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:08.146397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:08.147035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:08.153986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:08.154466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:08.155274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:08.155705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:08.302127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:08.314443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:08.316348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:08.318146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-97f35cc9-47fd-4a5f-878f-abd555ae412c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.178472 Dec 15 16:44:08.318697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1241/2269] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:08.882847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dee63fe5-091e-4ddc-b507-90cbbe486199 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:08.883599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dee63fe5-091e-4ddc-b507-90cbbe486199 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:08.892200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dee63fe5-091e-4ddc-b507-90cbbe486199 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:08.893030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dee63fe5-091e-4ddc-b507-90cbbe486199 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:08.894101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dee63fe5-091e-4ddc-b507-90cbbe486199 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:08.894672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dee63fe5-091e-4ddc-b507-90cbbe486199 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:09.042187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-dee63fe5-091e-4ddc-b507-90cbbe486199 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:09.050572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dee63fe5-091e-4ddc-b507-90cbbe486199 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.173916 Dec 15 16:44:09.051137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1029/2270] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:08 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:09.340932 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:09.341882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:09.351766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:09.352219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:09.353032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:09.353469 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:09.499053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:09.507689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:09.509200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:09.510347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2e7a6f2e-fc92-432d-b447-783b4878a9c1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.176014 Dec 15 16:44:09.510904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1242/2271] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:09 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:10.068864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f616c63a-f5b4-443a-b625-ef5cdf4ca137 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:10.069466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f616c63a-f5b4-443a-b625-ef5cdf4ca137 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:10.076138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f616c63a-f5b4-443a-b625-ef5cdf4ca137 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:10.076624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f616c63a-f5b4-443a-b625-ef5cdf4ca137 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:10.077410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f616c63a-f5b4-443a-b625-ef5cdf4ca137 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:10.077843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f616c63a-f5b4-443a-b625-ef5cdf4ca137 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:10.218807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f616c63a-f5b4-443a-b625-ef5cdf4ca137 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:10.230451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f616c63a-f5b4-443a-b625-ef5cdf4ca137 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166259 Dec 15 16:44:10.231240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1030/2272] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:10 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:10.533022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:10.533943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:10.541454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:10.541915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:10.542688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:10.543118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:10.631658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:44:10.631894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:44:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f (ip 10.222.0.30) !!! Dec 15 16:44:10.679393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:10.688097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:10.689588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:10.690723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-64fbedfe-3032-43fa-ad01-08a91a261a24 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.164075 Dec 15 16:44:10.691282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1243/2273] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:10 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:11.251915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9867610a-fe7f-487b-86c1-4811a34b7a32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:11.252976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9867610a-fe7f-487b-86c1-4811a34b7a32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:11.261001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9867610a-fe7f-487b-86c1-4811a34b7a32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:11.261439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9867610a-fe7f-487b-86c1-4811a34b7a32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:11.262228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9867610a-fe7f-487b-86c1-4811a34b7a32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:11.262658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9867610a-fe7f-487b-86c1-4811a34b7a32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:11.401979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9867610a-fe7f-487b-86c1-4811a34b7a32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:11.410499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9867610a-fe7f-487b-86c1-4811a34b7a32 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164768 Dec 15 16:44:11.411046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1031/2274] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:11 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:11.713098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:11.713830 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:11.722944 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:11.723552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:11.724623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:11.725499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:11.869100 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:11.878101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:11.879568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:11.880752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-25bd9b19-aa8f-41c3-90e7-6089848013cd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.173835 Dec 15 16:44:11.881290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1244/2275] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:11 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:12.430116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bafa4f02-ab50-4063-ac87-cff5a653cc14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:12.430696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bafa4f02-ab50-4063-ac87-cff5a653cc14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:12.437198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bafa4f02-ab50-4063-ac87-cff5a653cc14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:12.437643 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bafa4f02-ab50-4063-ac87-cff5a653cc14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:12.438436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bafa4f02-ab50-4063-ac87-cff5a653cc14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:12.438891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bafa4f02-ab50-4063-ac87-cff5a653cc14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:12.577467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bafa4f02-ab50-4063-ac87-cff5a653cc14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:12.585834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bafa4f02-ab50-4063-ac87-cff5a653cc14 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161219 Dec 15 16:44:12.586405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1032/2276] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:12 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:12.903447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:12.904391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:12.914120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:12.914571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:12.915334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:12.915796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:13.055963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:13.069060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:13.070561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:13.071712 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b01e42b5-11a2-413e-bade-f377cd5fdfa3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175069 Dec 15 16:44:13.072243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1245/2277] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:12 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:13.612459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-edc547dd-0e84-44c9-b60e-8d0cf255fe84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:13.613507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-edc547dd-0e84-44c9-b60e-8d0cf255fe84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:13.624004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edc547dd-0e84-44c9-b60e-8d0cf255fe84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:13.624812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edc547dd-0e84-44c9-b60e-8d0cf255fe84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:13.626108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edc547dd-0e84-44c9-b60e-8d0cf255fe84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:13.626835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edc547dd-0e84-44c9-b60e-8d0cf255fe84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:13.775911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-edc547dd-0e84-44c9-b60e-8d0cf255fe84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:13.784672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-edc547dd-0e84-44c9-b60e-8d0cf255fe84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.178366 Dec 15 16:44:13.785248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1033/2278] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:13 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:14.090382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:14.090999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:14.098047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:14.098484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:14.099276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:14.099713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:14.305734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:14.314366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:14.315816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:14.317020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8924b3ea-86a2-4c6c-8068-ed0049602ed4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.230442 Dec 15 16:44:14.317575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1246/2279] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:14 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:14.805809 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b6fcd4fc-c25d-4bed-932c-ad541ab598c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:14.806634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b6fcd4fc-c25d-4bed-932c-ad541ab598c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:14.815241 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4fc-c25d-4bed-932c-ad541ab598c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:14.815836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4fc-c25d-4bed-932c-ad541ab598c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:14.816917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4fc-c25d-4bed-932c-ad541ab598c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:14.817489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6fcd4fc-c25d-4bed-932c-ad541ab598c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:14.968032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b6fcd4fc-c25d-4bed-932c-ad541ab598c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:14.976898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b6fcd4fc-c25d-4bed-932c-ad541ab598c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.177017 Dec 15 16:44:14.977507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1034/2280] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:14 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:15.335685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:15.336296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:15.343324 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:15.343776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:15.344597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:15.345034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:15.479665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:15.491672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:15.493224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:15.494385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f9ebbab4-ec7e-4d27-ba81-d3a07b8bbc45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.163047 Dec 15 16:44:15.494953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1247/2281] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:15 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:15.998177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c0e7e39c-3bd4-45d1-a3a3-768d2d27df27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:15.999206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c0e7e39c-3bd4-45d1-a3a3-768d2d27df27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:16.010186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c0e7e39c-3bd4-45d1-a3a3-768d2d27df27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:16.011379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c0e7e39c-3bd4-45d1-a3a3-768d2d27df27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:16.012215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c0e7e39c-3bd4-45d1-a3a3-768d2d27df27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:16.012689 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c0e7e39c-3bd4-45d1-a3a3-768d2d27df27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:16.152230 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c0e7e39c-3bd4-45d1-a3a3-768d2d27df27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:16.161093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c0e7e39c-3bd4-45d1-a3a3-768d2d27df27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170025 Dec 15 16:44:16.161789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1035/2282] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:15 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:44:16.512783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:16.513381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:16.520165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:16.520644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:16.521417 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:16.521843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:16.666310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:16.675126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:16.676652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:16.677953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3dd0af4b-4ac6-4f50-adae-3a619c44ee10 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.168979 Dec 15 16:44:16.678546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1248/2283] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:16 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:17.185661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5f4836b9-d7e7-45ae-a914-9211a8b08491 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:17.186507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5f4836b9-d7e7-45ae-a914-9211a8b08491 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:17.195806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f4836b9-d7e7-45ae-a914-9211a8b08491 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:17.196476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f4836b9-d7e7-45ae-a914-9211a8b08491 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:17.197597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f4836b9-d7e7-45ae-a914-9211a8b08491 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:17.198399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f4836b9-d7e7-45ae-a914-9211a8b08491 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:17.337427 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5f4836b9-d7e7-45ae-a914-9211a8b08491 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:17.349882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5f4836b9-d7e7-45ae-a914-9211a8b08491 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169341 Dec 15 16:44:17.350725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1036/2284] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:17 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:17.700644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:17.701937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:17.711346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:17.712077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:17.713397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:17.715760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:17.856117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:17.868647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:17.870861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:17.872000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cb8f6c80-44b5-4fbf-a9aa-65ee5f976114 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.177971 Dec 15 16:44:17.872561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1249/2285] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:17 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:18.369151 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-88b956fa-8e96-40b6-af47-c8d256e7caf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:18.369723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-88b956fa-8e96-40b6-af47-c8d256e7caf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:18.377010 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-88b956fa-8e96-40b6-af47-c8d256e7caf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:18.377466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-88b956fa-8e96-40b6-af47-c8d256e7caf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:18.378281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-88b956fa-8e96-40b6-af47-c8d256e7caf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:18.378718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-88b956fa-8e96-40b6-af47-c8d256e7caf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:18.508626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-88b956fa-8e96-40b6-af47-c8d256e7caf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:18.516652 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-88b956fa-8e96-40b6-af47-c8d256e7caf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.151289 Dec 15 16:44:18.517203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1037/2286] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:18 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:18.894270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:18.895245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:18.906575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:18.907327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:18.908716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:18.909407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:19.054296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:19.064477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:19.065989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:19.067142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b42c2ef2-9f05-489e-a0ba-15007a964d96 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179177 Dec 15 16:44:19.067702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1250/2287] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:18 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:19.537913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e1c2ee6c-bb48-401f-9990-d982ee96163f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:19.538916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e1c2ee6c-bb48-401f-9990-d982ee96163f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:19.547370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee6c-bb48-401f-9990-d982ee96163f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:19.547821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee6c-bb48-401f-9990-d982ee96163f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:19.548645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee6c-bb48-401f-9990-d982ee96163f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:19.549078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee6c-bb48-401f-9990-d982ee96163f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:19.693165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1c2ee6c-bb48-401f-9990-d982ee96163f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:19.702688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e1c2ee6c-bb48-401f-9990-d982ee96163f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170987 Dec 15 16:44:19.703377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1038/2288] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:19 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:20.089155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:20.089913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:20.096890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:20.097343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:20.098120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:20.098547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:20.232863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:20.241624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:20.243101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:20.244255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dac24a59-5954-4f25-a8de-d7adb2348cae tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.161109 Dec 15 16:44:20.244862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1251/2289] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:20 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:20.719389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-08f9830b-2464-4cfa-9a25-926374648904 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:20.720101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-08f9830b-2464-4cfa-9a25-926374648904 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:20.726828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08f9830b-2464-4cfa-9a25-926374648904 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:20.727209 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08f9830b-2464-4cfa-9a25-926374648904 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:20.727993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08f9830b-2464-4cfa-9a25-926374648904 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:20.728423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08f9830b-2464-4cfa-9a25-926374648904 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:20.862273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-08f9830b-2464-4cfa-9a25-926374648904 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:20.870836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-08f9830b-2464-4cfa-9a25-926374648904 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.155481 Dec 15 16:44:20.871409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1039/2290] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:20 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:21.263111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:21.263680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:21.270259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:21.270680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:21.271468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:21.271902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:21.404199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:21.413328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:21.415225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:21.417495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-873a8b93-e5fc-443a-a6a5-67e126b4f565 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.158260 Dec 15 16:44:21.418063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1252/2291] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:21 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:21.888235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cf79d6f0-06a1-4685-bd03-c9350eb51aca tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:21.888910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cf79d6f0-06a1-4685-bd03-c9350eb51aca tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:21.895648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf79d6f0-06a1-4685-bd03-c9350eb51aca tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:21.896101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf79d6f0-06a1-4685-bd03-c9350eb51aca tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:21.896940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf79d6f0-06a1-4685-bd03-c9350eb51aca tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:21.897374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cf79d6f0-06a1-4685-bd03-c9350eb51aca tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:22.051394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cf79d6f0-06a1-4685-bd03-c9350eb51aca tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:22.061617 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cf79d6f0-06a1-4685-bd03-c9350eb51aca tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.177198 Dec 15 16:44:22.062193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1040/2292] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:21 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:22.438659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:22.439545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:22.448518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:22.448926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:22.449727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:22.450157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:22.591983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:22.600891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:22.602351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:22.603491 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-222eb4ea-9fce-4d44-aaf9-3d8e712b5e8f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.170578 Dec 15 16:44:22.604049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1253/2293] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:22 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:23.080714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d383b3cd-5760-4774-a942-9179cd9b172f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:23.081624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d383b3cd-5760-4774-a942-9179cd9b172f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:23.089387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d383b3cd-5760-4774-a942-9179cd9b172f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:23.089918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d383b3cd-5760-4774-a942-9179cd9b172f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:23.091579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d383b3cd-5760-4774-a942-9179cd9b172f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:23.091579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d383b3cd-5760-4774-a942-9179cd9b172f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:23.226892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d383b3cd-5760-4774-a942-9179cd9b172f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:23.234858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d383b3cd-5760-4774-a942-9179cd9b172f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.159188 Dec 15 16:44:23.235431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1041/2294] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:23 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:23.624198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:23.624938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:23.632085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:23.632571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:23.633343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:23.633770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:23.771181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:23.780121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:23.781634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:23.782781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-df5ac52b-c857-4020-a37a-cfe48ede72da tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.163824 Dec 15 16:44:23.783424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1254/2295] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:23 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:24.256165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-89edd83f-facf-4b44-91f2-58566ce07362 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:24.257116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-89edd83f-facf-4b44-91f2-58566ce07362 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:24.267867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-89edd83f-facf-4b44-91f2-58566ce07362 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:24.268661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-89edd83f-facf-4b44-91f2-58566ce07362 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:24.269908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-89edd83f-facf-4b44-91f2-58566ce07362 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:24.270654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-89edd83f-facf-4b44-91f2-58566ce07362 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:24.410472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-89edd83f-facf-4b44-91f2-58566ce07362 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:24.422777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-89edd83f-facf-4b44-91f2-58566ce07362 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172847 Dec 15 16:44:24.423639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1042/2296] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:24 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:24.804671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:24.805653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:24.816839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:24.817585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:24.818876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:24.819605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:24.962366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:24.972161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:24.973685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:24.974820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-847d933a-fb04-4d6f-873a-35bacc0317d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.176458 Dec 15 16:44:24.975403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1255/2297] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:24 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:25.445270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-435fae09-d2a3-450d-ac26-e5fdbadf6bb1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:25.446154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-435fae09-d2a3-450d-ac26-e5fdbadf6bb1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:25.454409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-435fae09-d2a3-450d-ac26-e5fdbadf6bb1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:25.454851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-435fae09-d2a3-450d-ac26-e5fdbadf6bb1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:25.455627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-435fae09-d2a3-450d-ac26-e5fdbadf6bb1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:25.456053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-435fae09-d2a3-450d-ac26-e5fdbadf6bb1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:25.589307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-435fae09-d2a3-450d-ac26-e5fdbadf6bb1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:25.597588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-435fae09-d2a3-450d-ac26-e5fdbadf6bb1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.158793 Dec 15 16:44:25.598161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1043/2298] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:25 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:25.998907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:25.999662 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:26.008043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:26.008650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:26.009670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:26.010214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:26.156316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:26.169525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:26.170995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:26.172279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-003db832-3d18-4c01-8b57-64c53ac29318 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179229 Dec 15 16:44:26.173191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1256/2299] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:25 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:26.618907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ae78c700-2165-4eaa-bed2-f56bd74125b5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:26.619925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ae78c700-2165-4eaa-bed2-f56bd74125b5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:26.627428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae78c700-2165-4eaa-bed2-f56bd74125b5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:26.627887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae78c700-2165-4eaa-bed2-f56bd74125b5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:26.628691 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae78c700-2165-4eaa-bed2-f56bd74125b5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:26.629129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ae78c700-2165-4eaa-bed2-f56bd74125b5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:26.771097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ae78c700-2165-4eaa-bed2-f56bd74125b5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:26.779757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ae78c700-2165-4eaa-bed2-f56bd74125b5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167034 Dec 15 16:44:26.780333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1044/2300] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:26 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:27.190318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:27.190907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:27.197421 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:27.197854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:27.198625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:27.199053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:27.329020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:27.337855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:27.339375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:27.340564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-96065f1d-1dd2-42d3-b71c-63bf7f3ca665 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.153919 Dec 15 16:44:27.341175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1257/2301] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:27 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:27.803616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-afcbef79-ec83-4320-a368-1ade6a50dd27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:27.804621 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-afcbef79-ec83-4320-a368-1ade6a50dd27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:27.815400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afcbef79-ec83-4320-a368-1ade6a50dd27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:27.816150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afcbef79-ec83-4320-a368-1ade6a50dd27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:27.817490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afcbef79-ec83-4320-a368-1ade6a50dd27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:27.818211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afcbef79-ec83-4320-a368-1ade6a50dd27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:27.960816 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-afcbef79-ec83-4320-a368-1ade6a50dd27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:27.971115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-afcbef79-ec83-4320-a368-1ade6a50dd27 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.173732 Dec 15 16:44:27.971670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1045/2302] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:27 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:28.360082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:28.360698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:28.367198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:28.367651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:28.368460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:28.368917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:28.502530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:28.514638 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:28.516095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:28.517269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a18f52ac-3cc7-4fb3-8232-bfe4b4658cf9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.161144 Dec 15 16:44:28.517825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1258/2303] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:28 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:28.992880 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7c6b38e0-f1cf-4195-a1f0-f6dd48ce1929 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:28.993876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7c6b38e0-f1cf-4195-a1f0-f6dd48ce1929 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:29.003239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c6b38e0-f1cf-4195-a1f0-f6dd48ce1929 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:29.003694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c6b38e0-f1cf-4195-a1f0-f6dd48ce1929 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:29.004478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c6b38e0-f1cf-4195-a1f0-f6dd48ce1929 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:29.004917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7c6b38e0-f1cf-4195-a1f0-f6dd48ce1929 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:29.398166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7c6b38e0-f1cf-4195-a1f0-f6dd48ce1929 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:29.406459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7c6b38e0-f1cf-4195-a1f0-f6dd48ce1929 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.419849 Dec 15 16:44:29.407037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1046/2304] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:28 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:29.539689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:29.540739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:29.552095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:29.552896 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:29.554179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:29.554999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:29.694067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:29.707856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:29.710228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:29.711664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7d82e2a2-6d7d-4f3b-8a4f-726704aa7f9e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.178030 Dec 15 16:44:29.712557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1259/2305] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:30.423047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-711d05c8-2eee-461e-89ec-d0d8967e7b4b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:30.423659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-711d05c8-2eee-461e-89ec-d0d8967e7b4b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:30.429659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-711d05c8-2eee-461e-89ec-d0d8967e7b4b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:30.430111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-711d05c8-2eee-461e-89ec-d0d8967e7b4b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:30.430884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-711d05c8-2eee-461e-89ec-d0d8967e7b4b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:30.431317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-711d05c8-2eee-461e-89ec-d0d8967e7b4b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:30.564929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-711d05c8-2eee-461e-89ec-d0d8967e7b4b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:30.576810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-711d05c8-2eee-461e-89ec-d0d8967e7b4b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.157131 Dec 15 16:44:30.577389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1047/2306] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:30 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:30.732187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:30.732973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:30.739501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:30.739920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:30.740757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:30.741187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:30.885855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:30.895319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:30.896807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:30.897961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dd9137c0-8af5-4eeb-9f79-21d466569917 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.169817 Dec 15 16:44:30.898519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1260/2307] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:30 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:31.594483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5c29806b-886e-45c2-9c90-80a08458725a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:31.595061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5c29806b-886e-45c2-9c90-80a08458725a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:31.602120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c29806b-886e-45c2-9c90-80a08458725a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:31.602560 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c29806b-886e-45c2-9c90-80a08458725a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:31.603354 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c29806b-886e-45c2-9c90-80a08458725a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:31.603778 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c29806b-886e-45c2-9c90-80a08458725a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:31.736727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5c29806b-886e-45c2-9c90-80a08458725a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:31.745054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5c29806b-886e-45c2-9c90-80a08458725a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.155145 Dec 15 16:44:31.745623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1048/2308] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:31 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:31.919460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:31.920477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:31.930553 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:31.931279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:31.932617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:31.933328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:32.089147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:32.098593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:32.100090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:32.101275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b7e39a54-52e9-4ac5-895a-e89bf85661f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.188030 Dec 15 16:44:32.101834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1261/2309] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:32.767099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d7a6b54b-6813-4012-9a59-52ab08a8a702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:32.768096 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d7a6b54b-6813-4012-9a59-52ab08a8a702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:32.778516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7a6b54b-6813-4012-9a59-52ab08a8a702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:32.779262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7a6b54b-6813-4012-9a59-52ab08a8a702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:32.780412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7a6b54b-6813-4012-9a59-52ab08a8a702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:32.780872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7a6b54b-6813-4012-9a59-52ab08a8a702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:32.920178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d7a6b54b-6813-4012-9a59-52ab08a8a702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:32.928599 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d7a6b54b-6813-4012-9a59-52ab08a8a702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167875 Dec 15 16:44:32.929202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1049/2310] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:32 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:33.126199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:33.127076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:33.137363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:33.138108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:33.139543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:33.139982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:33.277073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:33.285518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:33.287034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:33.288182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-874e727c-3720-4d22-9a1a-dec6baa64e36 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.169279 Dec 15 16:44:33.288787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1262/2311] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:33 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:34.155815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-68ff268d-e651-47fe-aa97-dfbc2ce2c702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:34.156415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-68ff268d-e651-47fe-aa97-dfbc2ce2c702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:34.162777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68ff268d-e651-47fe-aa97-dfbc2ce2c702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:34.163222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68ff268d-e651-47fe-aa97-dfbc2ce2c702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:34.164004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68ff268d-e651-47fe-aa97-dfbc2ce2c702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:34.164400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68ff268d-e651-47fe-aa97-dfbc2ce2c702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:34.292859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-68ff268d-e651-47fe-aa97-dfbc2ce2c702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:34.300704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-68ff268d-e651-47fe-aa97-dfbc2ce2c702 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.357891 Dec 15 16:44:34.301282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1050/2312] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:33 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:34.306821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:34.307502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:34.314701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:34.315148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:34.315921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:34.316352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:34.454206 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:34.464265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:34.465807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:34.467006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8804ee01-0703-4f04-add1-c8d0de5c6aab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.163820 Dec 15 16:44:34.467717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1263/2313] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:34 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:35.318162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-741c73ed-dbf8-4064-af16-20313837706e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:35.318740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-741c73ed-dbf8-4064-af16-20313837706e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:35.325496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-741c73ed-dbf8-4064-af16-20313837706e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:35.325953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-741c73ed-dbf8-4064-af16-20313837706e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:35.327103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-741c73ed-dbf8-4064-af16-20313837706e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:35.327582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-741c73ed-dbf8-4064-af16-20313837706e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:35.473675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-741c73ed-dbf8-4064-af16-20313837706e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:35.482111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-741c73ed-dbf8-4064-af16-20313837706e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167842 Dec 15 16:44:35.482765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1051/2314] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:35 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:35.485873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:35.486549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:35.493137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:35.493581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:35.494404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:35.494836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:35.636577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:35.645271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:35.646795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:35.647955 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1a02b387-6be2-4837-b1a2-6f5060d35b9c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.165918 Dec 15 16:44:35.648583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1264/2315] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:35 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:36.099439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:44:36.099789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:44:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:44:36.502714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-10447f79-1dfa-48e5-a427-a14184506282 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:36.503603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-10447f79-1dfa-48e5-a427-a14184506282 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:36.511999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10447f79-1dfa-48e5-a427-a14184506282 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:36.512636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10447f79-1dfa-48e5-a427-a14184506282 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:36.513674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10447f79-1dfa-48e5-a427-a14184506282 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:36.514405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-10447f79-1dfa-48e5-a427-a14184506282 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:36.658938 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-10447f79-1dfa-48e5-a427-a14184506282 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:36.666826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:36.667384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-10447f79-1dfa-48e5-a427-a14184506282 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169935 Dec 15 16:44:36.667513 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:36.667709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1052/2316] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:36 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:36.677498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:36.678054 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:36.678862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:36.679288 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:36.811452 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:36.820198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:36.821696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:36.822833 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-810d872f-5427-4466-9501-f56fcacb6197 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.159732 Dec 15 16:44:36.823392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1265/2317] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:36 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:37.686585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-49a0bc1e-9334-4cae-8507-ce4451627dc8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:37.687182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-49a0bc1e-9334-4cae-8507-ce4451627dc8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:37.693993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49a0bc1e-9334-4cae-8507-ce4451627dc8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:37.694426 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49a0bc1e-9334-4cae-8507-ce4451627dc8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:37.695274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49a0bc1e-9334-4cae-8507-ce4451627dc8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:37.695714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49a0bc1e-9334-4cae-8507-ce4451627dc8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:37.838951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-49a0bc1e-9334-4cae-8507-ce4451627dc8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:37.840838 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:37.841459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:37.847849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-49a0bc1e-9334-4cae-8507-ce4451627dc8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.165409 Dec 15 16:44:37.848461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1053/2318] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:37 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:37.852581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:37.852581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:37.852581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:37.852581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:38.157719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:38.166213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:38.167675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:38.168852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a74160cf-b88f-4c03-b42f-12b62698a379 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.331848 Dec 15 16:44:38.169440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1266/2319] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:37 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:38.869775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1d287e96-5d79-46cc-b019-5754adf0bba0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:38.870825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1d287e96-5d79-46cc-b019-5754adf0bba0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:38.882750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d287e96-5d79-46cc-b019-5754adf0bba0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:38.883498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d287e96-5d79-46cc-b019-5754adf0bba0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:38.884862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d287e96-5d79-46cc-b019-5754adf0bba0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:38.885591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1d287e96-5d79-46cc-b019-5754adf0bba0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:39.032757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1d287e96-5d79-46cc-b019-5754adf0bba0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:39.041367 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1d287e96-5d79-46cc-b019-5754adf0bba0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.177882 Dec 15 16:44:39.049563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1054/2320] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:38 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:39.189350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:39.189963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:39.196623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:39.197069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:39.197837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:39.198266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:39.238147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:44:39.238437 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:44:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:44:39.342080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:39.350986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:39.352472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:39.353739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4ece97bf-e4ef-41c2-bfef-7570ab89c612 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.169014 Dec 15 16:44:39.354255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1267/2321] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:39 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:40.059778 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a6e02c23-4838-4025-a2de-662405347d89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:40.060190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a6e02c23-4838-4025-a2de-662405347d89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:40.067288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6e02c23-4838-4025-a2de-662405347d89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:40.067732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6e02c23-4838-4025-a2de-662405347d89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:40.068545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6e02c23-4838-4025-a2de-662405347d89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:40.068979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a6e02c23-4838-4025-a2de-662405347d89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:40.201488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a6e02c23-4838-4025-a2de-662405347d89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:40.210672 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a6e02c23-4838-4025-a2de-662405347d89 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.155268 Dec 15 16:44:40.211239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1055/2322] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:40 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:40.376232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:40.377274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:40.387939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:40.388751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:40.389953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:40.390410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:40.530783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:40.539475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:40.540972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:40.542107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2539466b-46db-4baf-8ce5-cf4da7f3a027 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172122 Dec 15 16:44:40.542648 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1268/2323] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:40 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:41.228823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-50c6311e-92f9-4818-92f1-8079120d8fed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:41.229410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-50c6311e-92f9-4818-92f1-8079120d8fed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:41.236322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50c6311e-92f9-4818-92f1-8079120d8fed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:41.236803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50c6311e-92f9-4818-92f1-8079120d8fed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:41.237596 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50c6311e-92f9-4818-92f1-8079120d8fed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:41.238032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-50c6311e-92f9-4818-92f1-8079120d8fed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:41.382079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-50c6311e-92f9-4818-92f1-8079120d8fed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:41.393118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-50c6311e-92f9-4818-92f1-8079120d8fed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167943 Dec 15 16:44:41.393686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1056/2324] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:41 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:41.563701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:41.564397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:41.572166 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:41.572739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:41.573645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:41.574154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:41.709325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:41.718845 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:41.720316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:41.721494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6a1f92cf-5a14-49dc-ab26-c95ec3c5891e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.163297 Dec 15 16:44:41.722015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1269/2325] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:41 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:42.414447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2cb35a8d-fed3-4462-9052-9c8fe70c43c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:42.415389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2cb35a8d-fed3-4462-9052-9c8fe70c43c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:42.426015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2cb35a8d-fed3-4462-9052-9c8fe70c43c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:42.426746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2cb35a8d-fed3-4462-9052-9c8fe70c43c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:42.428015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2cb35a8d-fed3-4462-9052-9c8fe70c43c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:42.428838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2cb35a8d-fed3-4462-9052-9c8fe70c43c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:42.590806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2cb35a8d-fed3-4462-9052-9c8fe70c43c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:42.599708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2cb35a8d-fed3-4462-9052-9c8fe70c43c8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.191573 Dec 15 16:44:42.600272 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1057/2326] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:42 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:42.743254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:42.744115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:42.755636 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:42.756389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:42.757746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:42.758481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:42.910966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:42.919632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:42.921783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:42.922943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ecb98ee6-7804-4ecc-9bde-e397735fc99c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.186008 Dec 15 16:44:42.923502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1270/2327] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:42 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:43.620937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3d1a16d6-115c-4cdd-9d67-306787ac9495 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:43.621999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3d1a16d6-115c-4cdd-9d67-306787ac9495 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:43.632653 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d1a16d6-115c-4cdd-9d67-306787ac9495 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:43.633390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d1a16d6-115c-4cdd-9d67-306787ac9495 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:43.634679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d1a16d6-115c-4cdd-9d67-306787ac9495 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:43.635403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d1a16d6-115c-4cdd-9d67-306787ac9495 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:43.790358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3d1a16d6-115c-4cdd-9d67-306787ac9495 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:43.799473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3d1a16d6-115c-4cdd-9d67-306787ac9495 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.184439 Dec 15 16:44:43.800294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1058/2328] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:43 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:43.947496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:43.948372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:43.959732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:43.960494 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:43.961799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:43.962520 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:44.110366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:44.119135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:44.120671 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:44.121823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-547b6ae9-cf6a-400a-9907-2c83c010eee6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180718 Dec 15 16:44:44.122331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1271/2329] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:43 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:44.821026 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-81327d1d-04cd-45d5-a8b9-d1cd1212e1b0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:44.821980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-81327d1d-04cd-45d5-a8b9-d1cd1212e1b0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:44.831570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81327d1d-04cd-45d5-a8b9-d1cd1212e1b0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:44.832019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81327d1d-04cd-45d5-a8b9-d1cd1212e1b0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:44.832841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81327d1d-04cd-45d5-a8b9-d1cd1212e1b0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:44.833275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81327d1d-04cd-45d5-a8b9-d1cd1212e1b0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:44.975351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-81327d1d-04cd-45d5-a8b9-d1cd1212e1b0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:44.987963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-81327d1d-04cd-45d5-a8b9-d1cd1212e1b0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.173171 Dec 15 16:44:44.988564 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1059/2330] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:44 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:45.141665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:45.142505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:45.149846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:45.150296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:45.151081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:45.151510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:45.303178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:45.315259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:45.316768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:45.317920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-dcc0bfcf-e140-49ac-a133-d1cd359b5c87 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180021 Dec 15 16:44:45.318473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1272/2331] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:45 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:46.009222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-664f427b-1b0a-438c-ac99-cc2cacf8e0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:46.010416 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-664f427b-1b0a-438c-ac99-cc2cacf8e0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:46.021239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-664f427b-1b0a-438c-ac99-cc2cacf8e0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:46.021983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-664f427b-1b0a-438c-ac99-cc2cacf8e0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:46.023259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-664f427b-1b0a-438c-ac99-cc2cacf8e0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:46.024022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-664f427b-1b0a-438c-ac99-cc2cacf8e0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:46.164118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-664f427b-1b0a-438c-ac99-cc2cacf8e0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:46.172913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-664f427b-1b0a-438c-ac99-cc2cacf8e0d0 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169764 Dec 15 16:44:46.173702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1060/2332] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:46 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:46.340890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:46.341881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:46.353388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:46.354139 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:46.355423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:46.356148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:46.493368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:46.502254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:46.503731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:46.504931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-958b4806-722f-4ca4-97b0-deae044a119a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.170285 Dec 15 16:44:46.505490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1273/2333] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:46 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:47.191358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cd093372-58a4-464b-aea0-677a3080d1f3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:47.192000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cd093372-58a4-464b-aea0-677a3080d1f3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:47.199632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd093372-58a4-464b-aea0-677a3080d1f3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:47.200137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd093372-58a4-464b-aea0-677a3080d1f3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:47.201041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd093372-58a4-464b-aea0-677a3080d1f3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:47.201526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd093372-58a4-464b-aea0-677a3080d1f3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:47.348835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cd093372-58a4-464b-aea0-677a3080d1f3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:47.357512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cd093372-58a4-464b-aea0-677a3080d1f3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170324 Dec 15 16:44:47.358089 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1061/2334] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:47 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:47.527472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:47.528373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:47.536847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:47.537293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:47.539339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:47.539339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:47.689886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:47.698339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:47.699815 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:47.701016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-91499442-b120-4a70-8e1b-6278e29d1dd9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180063 Dec 15 16:44:47.701614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1274/2335] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:47 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:48.378197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-699de318-3cb8-4444-8047-6716a87587ac tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:48.378778 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-699de318-3cb8-4444-8047-6716a87587ac tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:48.385506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-699de318-3cb8-4444-8047-6716a87587ac tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:48.386216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-699de318-3cb8-4444-8047-6716a87587ac tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:48.386997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-699de318-3cb8-4444-8047-6716a87587ac tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:48.387424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-699de318-3cb8-4444-8047-6716a87587ac tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:48.517448 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-699de318-3cb8-4444-8047-6716a87587ac tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:48.525738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-699de318-3cb8-4444-8047-6716a87587ac tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.153260 Dec 15 16:44:48.526317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1062/2336] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:48 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:48.719323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:48.719894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:48.726806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:48.727253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:48.728035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:48.728473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:48.858879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:48.868018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:48.869521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:48.870685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-57ebce4d-99c9-4053-a6b1-bb8205819d4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.155437 Dec 15 16:44:48.871249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1275/2337] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:48 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:49.545014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f56d5df7-9c18-4acf-bbca-30e30788678b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:49.545858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f56d5df7-9c18-4acf-bbca-30e30788678b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:49.553529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f56d5df7-9c18-4acf-bbca-30e30788678b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:49.553983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f56d5df7-9c18-4acf-bbca-30e30788678b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:49.554737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f56d5df7-9c18-4acf-bbca-30e30788678b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:49.555204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f56d5df7-9c18-4acf-bbca-30e30788678b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:49.712883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f56d5df7-9c18-4acf-bbca-30e30788678b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:49.721957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f56d5df7-9c18-4acf-bbca-30e30788678b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.182604 Dec 15 16:44:49.722895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1063/2338] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:49 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:49.892284 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:49.893269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:49.904280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:49.905093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:49.906393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:49.907127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:50.071566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:50.080518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:50.082075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:50.083156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-31f47037-1a38-40f5-b382-50c68cf7e53e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.197074 Dec 15 16:44:50.083741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1276/2339] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:49 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:50.744061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1e596309-eb6e-48f9-a16f-2c803f2ad5d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:50.744815 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1e596309-eb6e-48f9-a16f-2c803f2ad5d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:50.753095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e596309-eb6e-48f9-a16f-2c803f2ad5d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:50.753653 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e596309-eb6e-48f9-a16f-2c803f2ad5d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:50.754659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e596309-eb6e-48f9-a16f-2c803f2ad5d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:50.755200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e596309-eb6e-48f9-a16f-2c803f2ad5d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:50.903156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1e596309-eb6e-48f9-a16f-2c803f2ad5d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:50.911598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1e596309-eb6e-48f9-a16f-2c803f2ad5d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172348 Dec 15 16:44:50.912127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1064/2340] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:50 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:51.106306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:51.107406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:51.115575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:51.116028 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:51.116856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:51.117298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:51.271348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:51.284098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:51.285639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:51.286829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fdf80d77-4cfe-4a7e-87da-a12926f7a2eb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.186814 Dec 15 16:44:51.287394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1277/2341] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:51 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:51.928200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e622a34e-6afc-4d2c-9006-63fc47d9187f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:51.928931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e622a34e-6afc-4d2c-9006-63fc47d9187f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:51.935655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e622a34e-6afc-4d2c-9006-63fc47d9187f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:51.936110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e622a34e-6afc-4d2c-9006-63fc47d9187f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:51.936908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e622a34e-6afc-4d2c-9006-63fc47d9187f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:51.937340 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e622a34e-6afc-4d2c-9006-63fc47d9187f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:52.073141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e622a34e-6afc-4d2c-9006-63fc47d9187f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:52.085901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e622a34e-6afc-4d2c-9006-63fc47d9187f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161110 Dec 15 16:44:52.086668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1065/2342] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:51 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:52.307748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:52.308493 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:52.319510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:52.320624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:52.321669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:52.324196 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:52.476705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:52.485603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:52.487092 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:52.488242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-653ea728-83b5-4b92-913d-3c082851f481 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.185611 Dec 15 16:44:52.488837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1278/2343] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:52 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:53.107261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8e204eed-d9e2-4eee-840a-54670e6cb829 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:53.107870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8e204eed-d9e2-4eee-840a-54670e6cb829 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:53.114751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e204eed-d9e2-4eee-840a-54670e6cb829 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:53.115200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e204eed-d9e2-4eee-840a-54670e6cb829 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:53.115951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e204eed-d9e2-4eee-840a-54670e6cb829 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:53.116379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e204eed-d9e2-4eee-840a-54670e6cb829 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:53.264084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8e204eed-d9e2-4eee-840a-54670e6cb829 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:53.272277 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8e204eed-d9e2-4eee-840a-54670e6cb829 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168656 Dec 15 16:44:53.273147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1066/2344] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:53 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:53.511046 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:53.511905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:53.522634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:53.523388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:53.524757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:53.525483 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:53.666848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:53.679744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:53.682101 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:53.683869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-945feb28-a539-49b0-8a8f-10ba326636a8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.179072 Dec 15 16:44:53.684711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1279/2345] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:53 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:54.293983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-46fb1d20-b97d-4285-96d1-e20bc21041f5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:54.294838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-46fb1d20-b97d-4285-96d1-e20bc21041f5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:54.305809 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46fb1d20-b97d-4285-96d1-e20bc21041f5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:54.306539 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46fb1d20-b97d-4285-96d1-e20bc21041f5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:54.307804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46fb1d20-b97d-4285-96d1-e20bc21041f5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:54.308521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46fb1d20-b97d-4285-96d1-e20bc21041f5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:54.453501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-46fb1d20-b97d-4285-96d1-e20bc21041f5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:54.463426 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-46fb1d20-b97d-4285-96d1-e20bc21041f5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.175823 Dec 15 16:44:54.463980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1067/2346] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:54 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:54.705784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:54.706368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:54.713117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:54.713561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:54.714335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:54.714766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:54.857345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:54.865751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:54.867191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:54.868338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7f4a0271-fee8-4133-9896-4ee3bb7cdecd tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.168201 Dec 15 16:44:54.868929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1280/2347] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:54 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:55.485298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-49547d4b-63b8-4c40-a6ef-d4d50c15c50e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:55.486244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-49547d4b-63b8-4c40-a6ef-d4d50c15c50e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:55.492986 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49547d4b-63b8-4c40-a6ef-d4d50c15c50e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:55.493439 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49547d4b-63b8-4c40-a6ef-d4d50c15c50e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:55.494231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49547d4b-63b8-4c40-a6ef-d4d50c15c50e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:55.494668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49547d4b-63b8-4c40-a6ef-d4d50c15c50e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:55.625913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-49547d4b-63b8-4c40-a6ef-d4d50c15c50e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:55.634022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-49547d4b-63b8-4c40-a6ef-d4d50c15c50e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.154904 Dec 15 16:44:55.634618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1068/2348] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:55 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:55.890926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:55.891917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:55.902595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:55.903348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:55.904698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:55.905421 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:56.042797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:56.053158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:56.054632 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:56.055780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-11be3fc6-4814-45b5-a0be-3b4bbdcdf6d9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171110 Dec 15 16:44:56.056330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1281/2349] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:55 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:56.655221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1619c35d-2b93-48ba-8d0f-b2718d280100 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:56.656225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1619c35d-2b93-48ba-8d0f-b2718d280100 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:56.663723 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1619c35d-2b93-48ba-8d0f-b2718d280100 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:56.664162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1619c35d-2b93-48ba-8d0f-b2718d280100 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:56.664974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1619c35d-2b93-48ba-8d0f-b2718d280100 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:56.665396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1619c35d-2b93-48ba-8d0f-b2718d280100 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:56.817580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1619c35d-2b93-48ba-8d0f-b2718d280100 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:56.829921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1619c35d-2b93-48ba-8d0f-b2718d280100 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.180591 Dec 15 16:44:56.830516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1069/2350] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:56 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:57.081298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:57.082022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:57.089866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:57.090410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:57.091337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:57.091868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:57.226482 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:57.235147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:57.236819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:57.238011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5c7c8783-b7ef-451f-9ef6-5b78b614426e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.162737 Dec 15 16:44:57.238538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1282/2351] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:57 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:57.852514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cb6274fb-a2dd-464f-a2f0-4d23ccd9d73d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:57.853477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cb6274fb-a2dd-464f-a2f0-4d23ccd9d73d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:57.862854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb6274fb-a2dd-464f-a2f0-4d23ccd9d73d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:57.863327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb6274fb-a2dd-464f-a2f0-4d23ccd9d73d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:57.864136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb6274fb-a2dd-464f-a2f0-4d23ccd9d73d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:57.864607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb6274fb-a2dd-464f-a2f0-4d23ccd9d73d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:58.009766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cb6274fb-a2dd-464f-a2f0-4d23ccd9d73d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:58.021323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cb6274fb-a2dd-464f-a2f0-4d23ccd9d73d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.175586 Dec 15 16:44:58.021902 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1070/2352] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:57 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:58.257451 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:58.258090 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:58.264474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:58.264953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:58.265745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:58.266179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:58.414925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:58.423244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:58.424780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:58.425931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d8dc8770-8c1b-4add-af3b-c458ff5e40b3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.172968 Dec 15 16:44:58.426483 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1283/2353] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:58 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:44:59.039052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-610c2f72-da7a-497e-b963-06af40add0d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:59.039664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-610c2f72-da7a-497e-b963-06af40add0d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:59.046408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-610c2f72-da7a-497e-b963-06af40add0d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:59.046852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-610c2f72-da7a-497e-b963-06af40add0d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:59.047622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-610c2f72-da7a-497e-b963-06af40add0d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:59.048085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-610c2f72-da7a-497e-b963-06af40add0d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:59.192685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-610c2f72-da7a-497e-b963-06af40add0d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:59.202882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-610c2f72-da7a-497e-b963-06af40add0d2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167626 Dec 15 16:44:59.203499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1071/2354] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:44:59 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:44:59.444286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:44:59.444839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:44:59.451783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:59.452242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:59.453072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:44:59.453514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:44:59.588065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:59.597884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:59.599354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:44:59.600536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9f4b65d0-fc08-4a4c-9889-bd689f2796c2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.160006 Dec 15 16:44:59.601065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1284/2355] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:44:59 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:00.225004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5aadf0c3-a39b-42b9-9394-ae889f8857bb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:00.225952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5aadf0c3-a39b-42b9-9394-ae889f8857bb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:00.236256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5aadf0c3-a39b-42b9-9394-ae889f8857bb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:00.237039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5aadf0c3-a39b-42b9-9394-ae889f8857bb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:00.238316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5aadf0c3-a39b-42b9-9394-ae889f8857bb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:00.239030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5aadf0c3-a39b-42b9-9394-ae889f8857bb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:00.384994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5aadf0c3-a39b-42b9-9394-ae889f8857bb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:00.397859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5aadf0c3-a39b-42b9-9394-ae889f8857bb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.179175 Dec 15 16:45:00.398728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1072/2356] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:00 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:00.622745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:00.623697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:00.634548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:00.635705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:00.637160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:00.637974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:00.778746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:00.793301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:00.795738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:00.797626 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b71e74e7-d9e8-4d1d-96e0-7420c30619f1 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180798 Dec 15 16:45:00.798531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1285/2357] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:00 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:01.422550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bb5bfff5-0b0d-4c92-bf3a-5dfc30ba2c6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:01.423433 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bb5bfff5-0b0d-4c92-bf3a-5dfc30ba2c6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:01.431002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bb5bfff5-0b0d-4c92-bf3a-5dfc30ba2c6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:01.431468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bb5bfff5-0b0d-4c92-bf3a-5dfc30ba2c6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:01.432287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bb5bfff5-0b0d-4c92-bf3a-5dfc30ba2c6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:01.432799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bb5bfff5-0b0d-4c92-bf3a-5dfc30ba2c6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:01.577218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bb5bfff5-0b0d-4c92-bf3a-5dfc30ba2c6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:01.587008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bb5bfff5-0b0d-4c92-bf3a-5dfc30ba2c6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168849 Dec 15 16:45:01.587629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1073/2358] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:01 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:01.817974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:01.818564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:01.825552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:01.826019 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:01.826831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:01.827282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:01.978282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:01.989075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:01.990549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:01.991698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-76e4e068-0ccc-481b-b8bc-ec242baaa5d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.177913 Dec 15 16:45:01.992227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1286/2359] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:01 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:02.603697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b6438678-61da-4d3d-af33-579d08d9b344 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:02.604418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b6438678-61da-4d3d-af33-579d08d9b344 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:02.613882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6438678-61da-4d3d-af33-579d08d9b344 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:02.614411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6438678-61da-4d3d-af33-579d08d9b344 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:02.615343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6438678-61da-4d3d-af33-579d08d9b344 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:02.615861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b6438678-61da-4d3d-af33-579d08d9b344 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:02.747650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b6438678-61da-4d3d-af33-579d08d9b344 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:02.755490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b6438678-61da-4d3d-af33-579d08d9b344 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.156156 Dec 15 16:45:02.756061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1074/2360] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:02 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:03.014023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:03.014899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:03.022738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:03.023225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:03.024014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:03.024466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:03.164504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:03.177726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:03.180130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:03.182010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7745f577-e286-41ed-9128-0938125819a9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.174010 Dec 15 16:45:03.182842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1287/2361] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:03 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:03.772255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-172a9e73-23bc-4b4f-bab0-bf8ac62b7d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:03.772983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-172a9e73-23bc-4b4f-bab0-bf8ac62b7d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:03.779395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-172a9e73-23bc-4b4f-bab0-bf8ac62b7d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:03.779911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-172a9e73-23bc-4b4f-bab0-bf8ac62b7d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:03.780793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-172a9e73-23bc-4b4f-bab0-bf8ac62b7d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:03.781303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-172a9e73-23bc-4b4f-bab0-bf8ac62b7d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:03.917307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-172a9e73-23bc-4b4f-bab0-bf8ac62b7d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:03.926681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-172a9e73-23bc-4b4f-bab0-bf8ac62b7d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.158018 Dec 15 16:45:03.927158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1075/2362] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:03 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:04.204575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:04.205564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:04.216043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:04.216849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:04.218124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:04.219218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:04.358594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:04.367453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:04.368948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:04.370080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0f12749a-e12f-4096-8ebe-70151b0bbcec tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.171917 Dec 15 16:45:04.370990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1288/2363] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:04 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:04.947602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0c68cb36-aa16-4278-9867-74f1028c505f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:04.948622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0c68cb36-aa16-4278-9867-74f1028c505f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:04.959505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c68cb36-aa16-4278-9867-74f1028c505f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:04.960238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c68cb36-aa16-4278-9867-74f1028c505f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:04.961609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c68cb36-aa16-4278-9867-74f1028c505f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:04.962328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c68cb36-aa16-4278-9867-74f1028c505f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:05.109670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0c68cb36-aa16-4278-9867-74f1028c505f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:05.117995 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0c68cb36-aa16-4278-9867-74f1028c505f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.176473 Dec 15 16:45:05.118633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1076/2364] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:04 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:05.394811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:05.395818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:05.406581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:05.407334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:05.408541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:05.408970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:05.552142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:05.564937 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:05.566436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:05.567606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6c15628a-d1a2-4a89-83a1-6161bf35962b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.180600 Dec 15 16:45:05.568169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1289/2365] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:05 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:06.137806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e1b9fd07-19f3-4cf8-9633-e5a0e41f501d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:06.138538 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e1b9fd07-19f3-4cf8-9633-e5a0e41f501d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:06.148673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1b9fd07-19f3-4cf8-9633-e5a0e41f501d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:06.149277 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1b9fd07-19f3-4cf8-9633-e5a0e41f501d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:06.150405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1b9fd07-19f3-4cf8-9633-e5a0e41f501d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:06.150979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1b9fd07-19f3-4cf8-9633-e5a0e41f501d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:06.289965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1b9fd07-19f3-4cf8-9633-e5a0e41f501d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:06.302342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e1b9fd07-19f3-4cf8-9633-e5a0e41f501d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170241 Dec 15 16:45:06.303217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1077/2366] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:06 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:06.590128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:06.591141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:06.602111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:06.602860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:06.604157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:06.604936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:06.747182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:06.756674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:06.758168 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:06.759328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9faaf109-853e-4cef-99f7-dfd7e7f036c9 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.175424 Dec 15 16:45:06.759897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1290/2367] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:06 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:07.327325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-802eedfd-d366-4826-bdaf-5ef2d1ee536d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:07.328135 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-802eedfd-d366-4826-bdaf-5ef2d1ee536d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:07.335768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-802eedfd-d366-4826-bdaf-5ef2d1ee536d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:07.336220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-802eedfd-d366-4826-bdaf-5ef2d1ee536d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:07.337041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-802eedfd-d366-4826-bdaf-5ef2d1ee536d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:07.337477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-802eedfd-d366-4826-bdaf-5ef2d1ee536d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:07.475347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-802eedfd-d366-4826-bdaf-5ef2d1ee536d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:07.484116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-802eedfd-d366-4826-bdaf-5ef2d1ee536d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.162941 Dec 15 16:45:07.484749 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1078/2368] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:07 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:07.781980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:07.782884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:07.789686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:07.790139 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:07.790923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:07.791473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:07.926056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:07.934874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:07.936370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:07.937547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0abb19e7-f7ae-4e87-aa28-b2b7894d85f4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.162073 Dec 15 16:45:07.938138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1291/2369] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:07 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:08.505117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9ca113f1-da07-45cc-99ca-6efad2d660d6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:08.505825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9ca113f1-da07-45cc-99ca-6efad2d660d6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:08.513600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ca113f1-da07-45cc-99ca-6efad2d660d6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:08.514127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ca113f1-da07-45cc-99ca-6efad2d660d6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:08.515043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ca113f1-da07-45cc-99ca-6efad2d660d6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:08.515553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ca113f1-da07-45cc-99ca-6efad2d660d6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:08.658667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9ca113f1-da07-45cc-99ca-6efad2d660d6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:08.666573 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9ca113f1-da07-45cc-99ca-6efad2d660d6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166702 Dec 15 16:45:08.667145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1079/2370] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:08 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:08.960610 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:08.961410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:08.972270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:08.972992 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:08.974041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:08.974661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:09.117226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:09.126343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:09.128816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:09.130073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-19c99060-7f09-4a42-93fc-cd53c7fb73f3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1801 microversion: 2.20 time: 0.176137 Dec 15 16:45:09.130651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1292/2371] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:08 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:09.148191 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3033100f-2751-41e6-96c5-9d7f9db16ff4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '.version_select at 0x7f3a7c034c10>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:09.166717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3033100f-2751-41e6-96c5-9d7f9db16ff4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82452724" status: 204 len: 0 microversion: 2.20 time: 0.022151 Dec 15 16:45:09.167510 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1080/2372] 10.222.0.30 () {60 vars in 1255 bytes} [Wed Dec 15 16:45:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82452724 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:45:09.181733 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e28d1d8c-4ccb-47f5-99df-1c0763b033cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:09.182286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e28d1d8c-4ccb-47f5-99df-1c0763b033cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:09.188387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e28d1d8c-4ccb-47f5-99df-1c0763b033cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:09.188880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e28d1d8c-4ccb-47f5-99df-1c0763b033cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:09.190127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e28d1d8c-4ccb-47f5-99df-1c0763b033cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:09.190569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e28d1d8c-4ccb-47f5-99df-1c0763b033cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:09.214836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e28d1d8c-4ccb-47f5-99df-1c0763b033cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:45:09.294892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e28d1d8c-4ccb-47f5-99df-1c0763b033cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "DELETE /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 204 len: 0 microversion: 2.1 time: 0.116490 Dec 15 16:45:09.295486 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1293/2373] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:45:09 2021] DELETE /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:45:09.304049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7ebbeb0e-47a9-4e57-9f50-2f2b34656f5f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:09.304685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7ebbeb0e-47a9-4e57-9f50-2f2b34656f5f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:09.310654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ebbeb0e-47a9-4e57-9f50-2f2b34656f5f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:09.311097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ebbeb0e-47a9-4e57-9f50-2f2b34656f5f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:09.311894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ebbeb0e-47a9-4e57-9f50-2f2b34656f5f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:09.312297 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ebbeb0e-47a9-4e57-9f50-2f2b34656f5f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:09.446836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7ebbeb0e-47a9-4e57-9f50-2f2b34656f5f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:09.455468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7ebbeb0e-47a9-4e57-9f50-2f2b34656f5f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1721 microversion: 2.1 time: 0.155032 Dec 15 16:45:09.456047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1081/2374] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:09.690304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5781a891-eed5-48bc-8f5e-1be68dad3638 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:09.690304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5781a891-eed5-48bc-8f5e-1be68dad3638 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:09.698949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5781a891-eed5-48bc-8f5e-1be68dad3638 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:09.699386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5781a891-eed5-48bc-8f5e-1be68dad3638 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:09.700200 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5781a891-eed5-48bc-8f5e-1be68dad3638 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:09.700722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5781a891-eed5-48bc-8f5e-1be68dad3638 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:09.833160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5781a891-eed5-48bc-8f5e-1be68dad3638 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:09.841428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5781a891-eed5-48bc-8f5e-1be68dad3638 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.159344 Dec 15 16:45:09.842005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1294/2375] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:09 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:10.215433 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-3ef4df9a-6877-4df4-afa9-f289f7b30427 req-755b24db-bbcf-4d96-b67c-1491d3021859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134cc886-afce-4a89-b875-cdf6768bfd8f", "tag": "9b8f6012-13ef-4292-8d62-47854410ace5"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:10.217117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:45:10.217117 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:45:10.230100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-3ef4df9a-6877-4df4-afa9-f289f7b30427 req-755b24db-bbcf-4d96-b67c-1491d3021859 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:10.234073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-3ef4df9a-6877-4df4-afa9-f289f7b30427 req-755b24db-bbcf-4d96-b67c-1491d3021859 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:10.250208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-3ef4df9a-6877-4df4-afa9-f289f7b30427 req-755b24db-bbcf-4d96-b67c-1491d3021859 service nova] Creating event network-changed:9b8f6012-13ef-4292-8d62-47854410ace5 for instance 134cc886-afce-4a89-b875-cdf6768bfd8f on hv-cinder-82002 Dec 15 16:45:10.256944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-3ef4df9a-6877-4df4-afa9-f289f7b30427 req-755b24db-bbcf-4d96-b67c-1491d3021859 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130291 Dec 15 16:45:10.257915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1082/2376] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:45:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:45:10.311365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fbd3cae1-e561-4bc2-92c0-61e970118ca4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'create', calling method: .version_select at 0x7f3a81086160>, body: {"keypair": {"name": "tempest-keypair-85624778"}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:10.328699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-fbd3cae1-e561-4bc2-92c0-61e970118ca4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:45:10.334164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-fbd3cae1-e561-4bc2-92c0-61e970118ca4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for user b7f047bf1080497290a18bff8b4e4337 and project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:45:10.476239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-01defffb-bc38-44ea-af28-1d043a38c465 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:10.477412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-01defffb-bc38-44ea-af28-1d043a38c465 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:10.484984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-01defffb-bc38-44ea-af28-1d043a38c465 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:10.485791 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-01defffb-bc38-44ea-af28-1d043a38c465 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:10.487098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-01defffb-bc38-44ea-af28-1d043a38c465 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:10.487742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-01defffb-bc38-44ea-af28-1d043a38c465 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:10.794215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-01defffb-bc38-44ea-af28-1d043a38c465 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:10.803210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-01defffb-bc38-44ea-af28-1d043a38c465 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1721 microversion: 2.1 time: 0.333123 Dec 15 16:45:10.814143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1083/2377] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:10.830303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-fbd3cae1-e561-4bc2-92c0-61e970118ca4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:45:10.834341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-fbd3cae1-e561-4bc2-92c0-61e970118ca4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for user b7f047bf1080497290a18bff8b4e4337 and project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:45:10.848499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fbd3cae1-e561-4bc2-92c0-61e970118ca4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.20 time: 0.540929 Dec 15 16:45:10.849823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1295/2378] 10.222.0.30 () {62 vars in 1198 bytes} [Wed Dec 15 16:45:10 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 543 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:45:10.877555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8310cb1c-8087-4075-a7fe-fb839406ef63 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:10.881438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8310cb1c-8087-4075-a7fe-fb839406ef63 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:10.889454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8310cb1c-8087-4075-a7fe-fb839406ef63 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:10.890490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8310cb1c-8087-4075-a7fe-fb839406ef63 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:10.894799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8310cb1c-8087-4075-a7fe-fb839406ef63 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:10.895473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8310cb1c-8087-4075-a7fe-fb839406ef63 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:11.611646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8310cb1c-8087-4075-a7fe-fb839406ef63 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:11.620644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8310cb1c-8087-4075-a7fe-fb839406ef63 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.754132 Dec 15 16:45:11.621593 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1084/2379] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:10 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:11.820581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9ed3596e-ffbf-4cde-8006-612823b6de05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:11.821197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9ed3596e-ffbf-4cde-8006-612823b6de05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:11.828809 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ed3596e-ffbf-4cde-8006-612823b6de05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:11.830812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ed3596e-ffbf-4cde-8006-612823b6de05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:11.831822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ed3596e-ffbf-4cde-8006-612823b6de05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:11.833629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9ed3596e-ffbf-4cde-8006-612823b6de05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:11.891199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-30485f72-795f-4277-b177-aa951edfa674 req-e1928bf6-f9c0-4f45-b87f-1feb5263d8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58544761-395a-4b54-876b-38750b3d8cf1", "name": "network-vif-deleted", "tag": "3d529e67-64e7-4ad6-8519-0a44d19e090e"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:11.893004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:45:11.893004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:45:11.903825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9ed3596e-ffbf-4cde-8006-612823b6de05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:11.906633 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-30485f72-795f-4277-b177-aa951edfa674 req-e1928bf6-f9c0-4f45-b87f-1feb5263d8f8 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:11.907152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-30485f72-795f-4277-b177-aa951edfa674 req-e1928bf6-f9c0-4f45-b87f-1feb5263d8f8 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:11.912017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9ed3596e-ffbf-4cde-8006-612823b6de05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1653 microversion: 2.1 time: 0.095137 Dec 15 16:45:11.913217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1085/2380] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1653 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:11.920335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-30485f72-795f-4277-b177-aa951edfa674 req-e1928bf6-f9c0-4f45-b87f-1feb5263d8f8 service nova] Creating event network-vif-deleted:3d529e67-64e7-4ad6-8519-0a44d19e090e for instance 58544761-395a-4b54-876b-38750b3d8cf1 on hv-cinder-82002 Dec 15 16:45:11.926353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-30485f72-795f-4277-b177-aa951edfa674 req-e1928bf6-f9c0-4f45-b87f-1feb5263d8f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126828 Dec 15 16:45:11.927052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1296/2381] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:45:12.590940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-380655890", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29861749-eeff-4f47-ab67-6cbd4ee56a63"}], "security_groups": [{"name": "tempest-securitygroup--403851101"}], "key_name": "tempest-keypair-85624778", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:12.639295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1f1d8cf5-0775-4c76-aacc-fb7beb927c84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:12.640136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1f1d8cf5-0775-4c76-aacc-fb7beb927c84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:12.648160 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f1d8cf5-0775-4c76-aacc-fb7beb927c84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:12.648640 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f1d8cf5-0775-4c76-aacc-fb7beb927c84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:12.649433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f1d8cf5-0775-4c76-aacc-fb7beb927c84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:12.649895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f1d8cf5-0775-4c76-aacc-fb7beb927c84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:12.704939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.network.neutron [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] validate_networks() for [('29861749-eeff-4f47-ab67-6cbd4ee56a63', None, None, None, None, None)] {{(pid=116022) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:45:12.884720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1f1d8cf5-0775-4c76-aacc-fb7beb927c84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:12.894152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1f1d8cf5-0775-4c76-aacc-fb7beb927c84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.258957 Dec 15 16:45:12.895205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1297/2382] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:12 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:12.931147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7cfa764a-4fb6-4e89-9069-cec3179b49db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:12.931763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7cfa764a-4fb6-4e89-9069-cec3179b49db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:12.937941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7cfa764a-4fb6-4e89-9069-cec3179b49db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:12.938390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7cfa764a-4fb6-4e89-9069-cec3179b49db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:12.939406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7cfa764a-4fb6-4e89-9069-cec3179b49db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:12.939740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7cfa764a-4fb6-4e89-9069-cec3179b49db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:13.004121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7cfa764a-4fb6-4e89-9069-cec3179b49db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:13.012514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7cfa764a-4fb6-4e89-9069-cec3179b49db tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085969 Dec 15 16:45:13.013399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1298/2383] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:13.245796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Flavor limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:45:13.246225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Image limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:45:13.246687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Flavor pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:45:13.247088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Image pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:45:13.247491 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:45:13.256936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:13.257310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:13.258102 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:13.258533 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:13.274881 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:45:13.278834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Getting quotas for user b7f047bf1080497290a18bff8b4e4337 and project 4bb083b5a25444b3845b0f49b8b6f4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:45:13.289475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Going to run 1 instances... {{(pid=116022) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:45:13.291724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:45:13.339847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f618dbdb-017c-4839-b0bc-1770365a0216 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.753119 Dec 15 16:45:13.340720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1086/2384] 10.222.0.30 () {62 vars in 1187 bytes} [Wed Dec 15 16:45:12 2021] POST /compute/v2.1/servers => generated 401 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 16:45:13.350816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a3f18d36-4888-4d00-9054-321de5480607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:13.351419 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a3f18d36-4888-4d00-9054-321de5480607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:13.404893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a3f18d36-4888-4d00-9054-321de5480607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:13.412663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a3f18d36-4888-4d00-9054-321de5480607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:13.414243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a3f18d36-4888-4d00-9054-321de5480607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:13.415401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a3f18d36-4888-4d00-9054-321de5480607 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1279 microversion: 2.20 time: 0.068254 Dec 15 16:45:13.416117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1299/2385] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:13 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1279 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:13.911924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5f07618e-c70f-4529-a328-ecef7188cd9e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:13.912824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5f07618e-c70f-4529-a328-ecef7188cd9e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:13.919537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f07618e-c70f-4529-a328-ecef7188cd9e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:13.920018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f07618e-c70f-4529-a328-ecef7188cd9e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:13.920832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f07618e-c70f-4529-a328-ecef7188cd9e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:13.921265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5f07618e-c70f-4529-a328-ecef7188cd9e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:14.030807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9e3c9f61-9028-42e2-8b0e-404c736fc0c0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:14.032127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9e3c9f61-9028-42e2-8b0e-404c736fc0c0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:14.039400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e3c9f61-9028-42e2-8b0e-404c736fc0c0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:14.040076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e3c9f61-9028-42e2-8b0e-404c736fc0c0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:14.041221 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e3c9f61-9028-42e2-8b0e-404c736fc0c0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:14.041855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9e3c9f61-9028-42e2-8b0e-404c736fc0c0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:14.062900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5f07618e-c70f-4529-a328-ecef7188cd9e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:14.071170 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5f07618e-c70f-4529-a328-ecef7188cd9e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163845 Dec 15 16:45:14.071754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1087/2386] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:13 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:14.102635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9e3c9f61-9028-42e2-8b0e-404c736fc0c0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:14.110505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9e3c9f61-9028-42e2-8b0e-404c736fc0c0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083806 Dec 15 16:45:14.111142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1300/2387] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:14 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:14.434368 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:14.435106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:14.442182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:14.442634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:14.443426 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:14.443859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:14.529947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:14.538456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:14.539943 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:14.541083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2e2093dd-b625-4ec1-a5f3-12fdcda25740 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1349 microversion: 2.20 time: 0.110603 Dec 15 16:45:14.541629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1088/2388] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:14 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:15.088950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2982767e-6190-44f3-8984-f0463c671aa6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:15.089540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2982767e-6190-44f3-8984-f0463c671aa6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:15.096584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2982767e-6190-44f3-8984-f0463c671aa6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:15.097020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2982767e-6190-44f3-8984-f0463c671aa6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:15.098139 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2982767e-6190-44f3-8984-f0463c671aa6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:15.098561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2982767e-6190-44f3-8984-f0463c671aa6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:15.127677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-df386543-4a74-4bb5-bbe7-7c0973381eec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:15.129068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-df386543-4a74-4bb5-bbe7-7c0973381eec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:15.138182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df386543-4a74-4bb5-bbe7-7c0973381eec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:15.139068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df386543-4a74-4bb5-bbe7-7c0973381eec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:15.140600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df386543-4a74-4bb5-bbe7-7c0973381eec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:15.141036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df386543-4a74-4bb5-bbe7-7c0973381eec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:15.232458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-df386543-4a74-4bb5-bbe7-7c0973381eec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:15.240296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-df386543-4a74-4bb5-bbe7-7c0973381eec tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.116944 Dec 15 16:45:15.240895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1089/2389] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:15.398317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2982767e-6190-44f3-8984-f0463c671aa6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:15.406578 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2982767e-6190-44f3-8984-f0463c671aa6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.321315 Dec 15 16:45:15.407246 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1301/2390] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:15 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:15.559280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:15.559974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:15.566153 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:15.566586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:15.567356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:15.567782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:15.812056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:15.820062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:15.821592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:15.822678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e430e577-e49f-43a7-8e80-22c9abd814ac tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1404 microversion: 2.20 time: 0.267265 Dec 15 16:45:15.823246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1090/2391] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:15 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1404 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:15.936242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-766bea4b-7882-45ad-a352-bf7f44f16ade req-d600821d-8ba6-4a49-bfcc-a22d859ed6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8bc1c9-bc61-4861-98f9-f0acbeba3219", "tag": "9997c77e-4da9-4aed-96ce-4f8d7ead5391"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:15.938175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:45:15.938175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:45:15.951156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-766bea4b-7882-45ad-a352-bf7f44f16ade req-d600821d-8ba6-4a49-bfcc-a22d859ed6d1 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:15.951583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-766bea4b-7882-45ad-a352-bf7f44f16ade req-d600821d-8ba6-4a49-bfcc-a22d859ed6d1 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:15.963680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-766bea4b-7882-45ad-a352-bf7f44f16ade req-d600821d-8ba6-4a49-bfcc-a22d859ed6d1 service nova] Creating event network-changed:9997c77e-4da9-4aed-96ce-4f8d7ead5391 for instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 on hv-cinder-82002 Dec 15 16:45:15.969256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-766bea4b-7882-45ad-a352-bf7f44f16ade req-d600821d-8ba6-4a49-bfcc-a22d859ed6d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036157 Dec 15 16:45:15.969974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1302/2392] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:45:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:45:16.257931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c723a030-691e-4910-bbf9-7aea74c0178c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:16.258536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c723a030-691e-4910-bbf9-7aea74c0178c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:16.264944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c723a030-691e-4910-bbf9-7aea74c0178c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:16.265618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c723a030-691e-4910-bbf9-7aea74c0178c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:16.266373 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c723a030-691e-4910-bbf9-7aea74c0178c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:16.266820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c723a030-691e-4910-bbf9-7aea74c0178c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:16.345406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c723a030-691e-4910-bbf9-7aea74c0178c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:16.353321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c723a030-691e-4910-bbf9-7aea74c0178c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099032 Dec 15 16:45:16.353858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1091/2393] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:16 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:16.425097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d32207c8-8739-44da-b1ae-d4a19d6717f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:16.425885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d32207c8-8739-44da-b1ae-d4a19d6717f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:16.433414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d32207c8-8739-44da-b1ae-d4a19d6717f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:16.433858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d32207c8-8739-44da-b1ae-d4a19d6717f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:16.434645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d32207c8-8739-44da-b1ae-d4a19d6717f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:16.435076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d32207c8-8739-44da-b1ae-d4a19d6717f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:16.666685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d32207c8-8739-44da-b1ae-d4a19d6717f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:16.675466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d32207c8-8739-44da-b1ae-d4a19d6717f7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.255822 Dec 15 16:45:16.676039 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1303/2394] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:16 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:16.840908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:16.841584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:16.848349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:16.848901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:16.849679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:16.850083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:17.035030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:17.043072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:17.044591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:17.045727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b786f40d-5007-472b-9d03-65eca3a65eb6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1404 microversion: 2.20 time: 0.208572 Dec 15 16:45:17.046317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1092/2395] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:16 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1404 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:45:17.374251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6a3136c6-d6a5-4e7e-b8d4-5224d259993b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:17.375298 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6a3136c6-d6a5-4e7e-b8d4-5224d259993b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:17.382519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a3136c6-d6a5-4e7e-b8d4-5224d259993b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:17.382969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a3136c6-d6a5-4e7e-b8d4-5224d259993b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:17.383741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a3136c6-d6a5-4e7e-b8d4-5224d259993b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:17.384169 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a3136c6-d6a5-4e7e-b8d4-5224d259993b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:17.444348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6a3136c6-d6a5-4e7e-b8d4-5224d259993b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:17.452862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6a3136c6-d6a5-4e7e-b8d4-5224d259993b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084720 Dec 15 16:45:17.453425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1304/2396] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:17.694792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-06679f1e-9d20-48a7-ad73-83ae4c5c7610 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:17.695490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-06679f1e-9d20-48a7-ad73-83ae4c5c7610 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:17.703376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06679f1e-9d20-48a7-ad73-83ae4c5c7610 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:17.703902 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06679f1e-9d20-48a7-ad73-83ae4c5c7610 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:17.704867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06679f1e-9d20-48a7-ad73-83ae4c5c7610 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:17.706094 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-06679f1e-9d20-48a7-ad73-83ae4c5c7610 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:17.844701 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-06679f1e-9d20-48a7-ad73-83ae4c5c7610 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:17.858981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-06679f1e-9d20-48a7-ad73-83ae4c5c7610 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169166 Dec 15 16:45:17.859770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1093/2397] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:17 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:18.068380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:18.069401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:18.079786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:18.080746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:18.081343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:18.081769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:18.219856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:18.228275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:18.229781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:18.230872 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0d7113fb-07bc-4cb8-8b72-a04ec0461687 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1404 microversion: 2.20 time: 0.168977 Dec 15 16:45:18.231405 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1305/2398] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:18 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:18.471174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5e989b12-3adc-4eca-b662-be50287f7046 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:18.471698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5e989b12-3adc-4eca-b662-be50287f7046 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:18.478146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e989b12-3adc-4eca-b662-be50287f7046 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:18.478604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e989b12-3adc-4eca-b662-be50287f7046 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:18.479388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e989b12-3adc-4eca-b662-be50287f7046 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:18.479826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5e989b12-3adc-4eca-b662-be50287f7046 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:18.545889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5e989b12-3adc-4eca-b662-be50287f7046 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:18.555790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5e989b12-3adc-4eca-b662-be50287f7046 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088894 Dec 15 16:45:18.556339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1094/2399] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:18.880285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ff307d68-c799-4e89-82a9-cbf44163988c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:18.881315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ff307d68-c799-4e89-82a9-cbf44163988c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:18.892017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff307d68-c799-4e89-82a9-cbf44163988c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:18.892918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff307d68-c799-4e89-82a9-cbf44163988c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:18.894194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff307d68-c799-4e89-82a9-cbf44163988c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:18.894869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff307d68-c799-4e89-82a9-cbf44163988c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:19.036755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ff307d68-c799-4e89-82a9-cbf44163988c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:19.044698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ff307d68-c799-4e89-82a9-cbf44163988c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170510 Dec 15 16:45:19.045229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1306/2400] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:18 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:19.253296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:19.254156 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:19.264997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:19.265747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:19.267040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:19.267940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:19.403511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:19.411848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:19.413419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:19.414537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1cd07a74-2897-4976-ae4b-bd354ef5d41f tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1404 microversion: 2.20 time: 0.167628 Dec 15 16:45:19.415108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1095/2401] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:19 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:19.575745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-78e82506-c635-49c1-84cf-7bda0fabcea3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:19.576714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-78e82506-c635-49c1-84cf-7bda0fabcea3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:19.584466 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78e82506-c635-49c1-84cf-7bda0fabcea3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:19.584957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78e82506-c635-49c1-84cf-7bda0fabcea3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:19.585743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78e82506-c635-49c1-84cf-7bda0fabcea3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:19.586178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78e82506-c635-49c1-84cf-7bda0fabcea3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:19.651112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-78e82506-c635-49c1-84cf-7bda0fabcea3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:19.660394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-78e82506-c635-49c1-84cf-7bda0fabcea3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090621 Dec 15 16:45:19.661001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1307/2402] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:19 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:20.065932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-68889103-119d-4c6e-b50d-bacd62f049eb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:20.066933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-68889103-119d-4c6e-b50d-bacd62f049eb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:20.077203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68889103-119d-4c6e-b50d-bacd62f049eb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:20.077984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68889103-119d-4c6e-b50d-bacd62f049eb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:20.079206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68889103-119d-4c6e-b50d-bacd62f049eb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:20.079920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-68889103-119d-4c6e-b50d-bacd62f049eb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:20.211724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-68889103-119d-4c6e-b50d-bacd62f049eb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:20.220237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-68889103-119d-4c6e-b50d-bacd62f049eb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.160748 Dec 15 16:45:20.220969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1096/2403] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:20 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:20.436869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:20.437752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:20.445705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:20.446155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:20.446938 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:20.447373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:20.588401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:20.596884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:20.598355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:20.599443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b3c5063f-dcda-454b-a5b4-2d38aa3daa2e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1404 microversion: 2.20 time: 0.169059 Dec 15 16:45:20.600001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1308/2404] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:20 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:20.677909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-79145547-ecd7-472d-9f13-e51b153eb743 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:20.678512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-79145547-ecd7-472d-9f13-e51b153eb743 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:20.685199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79145547-ecd7-472d-9f13-e51b153eb743 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:20.685717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79145547-ecd7-472d-9f13-e51b153eb743 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:20.686590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79145547-ecd7-472d-9f13-e51b153eb743 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:20.687195 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79145547-ecd7-472d-9f13-e51b153eb743 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:20.748091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-79145547-ecd7-472d-9f13-e51b153eb743 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:20.756751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-79145547-ecd7-472d-9f13-e51b153eb743 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.082734 Dec 15 16:45:20.757365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1097/2405] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:20 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:21.241936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0430b28f-cc7f-4c42-bb69-ec0e530ff78a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:21.242849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0430b28f-cc7f-4c42-bb69-ec0e530ff78a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:21.252870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0430b28f-cc7f-4c42-bb69-ec0e530ff78a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:21.253306 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0430b28f-cc7f-4c42-bb69-ec0e530ff78a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:21.254076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0430b28f-cc7f-4c42-bb69-ec0e530ff78a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:21.254499 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0430b28f-cc7f-4c42-bb69-ec0e530ff78a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:21.385904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0430b28f-cc7f-4c42-bb69-ec0e530ff78a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:21.394391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0430b28f-cc7f-4c42-bb69-ec0e530ff78a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.158849 Dec 15 16:45:21.394962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1309/2406] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:21 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:21.621884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:21.622893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:21.633436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:21.634177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:21.635501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:21.636224 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:21.773300 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b6be897a-f593-4cc1-b55d-d4c1b2f8a380 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:21.773917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b6be897a-f593-4cc1-b55d-d4c1b2f8a380 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:21.778385 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:21.781115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6be897a-f593-4cc1-b55d-d4c1b2f8a380 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:21.781540 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6be897a-f593-4cc1-b55d-d4c1b2f8a380 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:21.782347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6be897a-f593-4cc1-b55d-d4c1b2f8a380 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:21.782800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6be897a-f593-4cc1-b55d-d4c1b2f8a380 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:21.786665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:21.788139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:21.789290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-96c4c5ce-779f-4569-9d3f-67b0bd7ecd7e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1404 microversion: 2.20 time: 0.173756 Dec 15 16:45:21.789827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1098/2407] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:21 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:21.849387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b6be897a-f593-4cc1-b55d-d4c1b2f8a380 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:21.861274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b6be897a-f593-4cc1-b55d-d4c1b2f8a380 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091358 Dec 15 16:45:21.861989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1310/2408] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:22.414851 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-141a63c0-4105-4ae7-b126-c27c81e422d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:22.415847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-141a63c0-4105-4ae7-b126-c27c81e422d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:22.425604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-141a63c0-4105-4ae7-b126-c27c81e422d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:22.426087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-141a63c0-4105-4ae7-b126-c27c81e422d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:22.426869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-141a63c0-4105-4ae7-b126-c27c81e422d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:22.427302 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-141a63c0-4105-4ae7-b126-c27c81e422d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:22.563892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-141a63c0-4105-4ae7-b126-c27c81e422d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:22.573275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-141a63c0-4105-4ae7-b126-c27c81e422d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164579 Dec 15 16:45:22.573854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1099/2409] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:22 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:22.749116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-7224139c-da30-4d26-8c34-c5b68db55807 req-fb811661-d9af-4724-b720-f684dca4adfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8bc1c9-bc61-4861-98f9-f0acbeba3219", "name": "network-vif-plugged", "status": "completed", "tag": "9997c77e-4da9-4aed-96ce-4f8d7ead5391"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:22.750629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:45:22.750629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:45:22.758792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-7224139c-da30-4d26-8c34-c5b68db55807 req-fb811661-d9af-4724-b720-f684dca4adfa service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:22.759223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-7224139c-da30-4d26-8c34-c5b68db55807 req-fb811661-d9af-4724-b720-f684dca4adfa service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:22.770229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-7224139c-da30-4d26-8c34-c5b68db55807 req-fb811661-d9af-4724-b720-f684dca4adfa service nova] Creating event network-vif-plugged:9997c77e-4da9-4aed-96ce-4f8d7ead5391 for instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 on hv-cinder-82002 Dec 15 16:45:22.775215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-7224139c-da30-4d26-8c34-c5b68db55807 req-fb811661-d9af-4724-b720-f684dca4adfa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086754 Dec 15 16:45:22.775808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1311/2410] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:45:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:45:22.807592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:22.808196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:22.814834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:22.815474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:22.816296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:22.816766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:22.884244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bf205d4c-e9b9-49bd-b346-4015e8ab3ba8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:22.884987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bf205d4c-e9b9-49bd-b346-4015e8ab3ba8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:22.891791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bf205d4c-e9b9-49bd-b346-4015e8ab3ba8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:22.892241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bf205d4c-e9b9-49bd-b346-4015e8ab3ba8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:22.893378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bf205d4c-e9b9-49bd-b346-4015e8ab3ba8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:22.893821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bf205d4c-e9b9-49bd-b346-4015e8ab3ba8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:22.986688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bf205d4c-e9b9-49bd-b346-4015e8ab3ba8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:22.995112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bf205d4c-e9b9-49bd-b346-4015e8ab3ba8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.115060 Dec 15 16:45:22.995877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1312/2411] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:23.020899 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:23.029344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:23.030838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:23.032002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4e4c4ce7-4359-4497-a1e5-7beca2e7ec61 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1404 microversion: 2.20 time: 0.228121 Dec 15 16:45:23.032604 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1100/2412] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:22 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:23.590754 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8bc5c3ef-f038-4ebe-bb17-c7e5b2512f72 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:23.591667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8bc5c3ef-f038-4ebe-bb17-c7e5b2512f72 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:23.598071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bc5c3ef-f038-4ebe-bb17-c7e5b2512f72 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:23.598528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bc5c3ef-f038-4ebe-bb17-c7e5b2512f72 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:23.599316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bc5c3ef-f038-4ebe-bb17-c7e5b2512f72 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:23.599747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8bc5c3ef-f038-4ebe-bb17-c7e5b2512f72 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:23.740637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8bc5c3ef-f038-4ebe-bb17-c7e5b2512f72 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:23.748607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8bc5c3ef-f038-4ebe-bb17-c7e5b2512f72 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161536 Dec 15 16:45:23.749260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1313/2413] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:23 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:24.013424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-538e554e-353a-472d-bcdf-3ea3fb18973f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:24.014085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-538e554e-353a-472d-bcdf-3ea3fb18973f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:24.022329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-538e554e-353a-472d-bcdf-3ea3fb18973f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:24.022782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-538e554e-353a-472d-bcdf-3ea3fb18973f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:24.023551 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-538e554e-353a-472d-bcdf-3ea3fb18973f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:24.023980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-538e554e-353a-472d-bcdf-3ea3fb18973f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:24.049868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:24.050572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:24.057528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:24.057983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:24.058779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:24.059220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:24.084912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-538e554e-353a-472d-bcdf-3ea3fb18973f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:24.093145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-538e554e-353a-472d-bcdf-3ea3fb18973f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084098 Dec 15 16:45:24.094070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1101/2414] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:24 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:24.195410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:24.203137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:24.204658 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:24.205754 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cf38b3d6-0471-4036-9705-510789e81b45 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1404 microversion: 2.20 time: 0.159730 Dec 15 16:45:24.206360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1314/2415] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:24 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:24.770628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5c79d32c-5ecc-4575-b266-671167787c23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:24.771285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5c79d32c-5ecc-4575-b266-671167787c23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:24.779161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c79d32c-5ecc-4575-b266-671167787c23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:24.779721 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c79d32c-5ecc-4575-b266-671167787c23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:24.780740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c79d32c-5ecc-4575-b266-671167787c23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:24.781244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c79d32c-5ecc-4575-b266-671167787c23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:24.927286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5c79d32c-5ecc-4575-b266-671167787c23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:24.935284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5c79d32c-5ecc-4575-b266-671167787c23 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.171286 Dec 15 16:45:24.935862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1102/2416] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:24 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:25.114264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1a576f5f-cdb9-4f3e-9b97-c625e001fca4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:25.115313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1a576f5f-cdb9-4f3e-9b97-c625e001fca4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:25.126122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a576f5f-cdb9-4f3e-9b97-c625e001fca4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:25.127761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a576f5f-cdb9-4f3e-9b97-c625e001fca4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:25.128076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a576f5f-cdb9-4f3e-9b97-c625e001fca4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:25.128752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a576f5f-cdb9-4f3e-9b97-c625e001fca4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:25.198413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1a576f5f-cdb9-4f3e-9b97-c625e001fca4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:25.206829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1a576f5f-cdb9-4f3e-9b97-c625e001fca4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098768 Dec 15 16:45:25.207389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1315/2417] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:25 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:25.223417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:25.224017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:25.230760 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:25.231202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:25.231969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:25.232396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:25.369009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:25.376853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:25.378377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:25.379610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-12202cba-daf5-48ee-96f4-41c81ac93b0c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1596 microversion: 2.20 time: 0.160004 Dec 15 16:45:25.380246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1103/2418] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:45:25 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1596 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:25.399181 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-18347732-7345-4999-92f1-11fe42105715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:25.399675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-18347732-7345-4999-92f1-11fe42105715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:25.405756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18347732-7345-4999-92f1-11fe42105715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:25.406209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18347732-7345-4999-92f1-11fe42105715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:25.406984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18347732-7345-4999-92f1-11fe42105715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:25.407410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18347732-7345-4999-92f1-11fe42105715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:25.496492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-18347732-7345-4999-92f1-11fe42105715 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100736 Dec 15 16:45:25.497412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1316/2419] 10.222.0.30 () {60 vars in 1315 bytes} [Wed Dec 15 16:45:25 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:45:25.953131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2ee4f1bb-ab5f-4e58-a9ae-dcfac4eafbee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:25.953746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2ee4f1bb-ab5f-4e58-a9ae-dcfac4eafbee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:25.960110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ee4f1bb-ab5f-4e58-a9ae-dcfac4eafbee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:25.960674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ee4f1bb-ab5f-4e58-a9ae-dcfac4eafbee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:25.961528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ee4f1bb-ab5f-4e58-a9ae-dcfac4eafbee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:25.961960 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2ee4f1bb-ab5f-4e58-a9ae-dcfac4eafbee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:26.183002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2ee4f1bb-ab5f-4e58-a9ae-dcfac4eafbee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:26.191173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2ee4f1bb-ab5f-4e58-a9ae-dcfac4eafbee tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.241810 Dec 15 16:45:26.192210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1104/2420] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:25 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:26.225182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fa8dc902-6ace-44ac-8c88-541d7abce519 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:26.225753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fa8dc902-6ace-44ac-8c88-541d7abce519 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:26.231972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa8dc902-6ace-44ac-8c88-541d7abce519 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:26.232418 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa8dc902-6ace-44ac-8c88-541d7abce519 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:26.233216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa8dc902-6ace-44ac-8c88-541d7abce519 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:26.233642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fa8dc902-6ace-44ac-8c88-541d7abce519 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:26.306217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fa8dc902-6ace-44ac-8c88-541d7abce519 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:26.314406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fa8dc902-6ace-44ac-8c88-541d7abce519 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093647 Dec 15 16:45:26.314958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1317/2421] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:26.841474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5cbf50c6-93d8-4ce2-ae01-121fd08733f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:26.847382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-f1733e92-1536-4e4a-a878-d4dc2ca73583 req-7135b479-ea28-4804-bf88-3d0dd254307e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8bc1c9-bc61-4861-98f9-f0acbeba3219", "tag": "9997c77e-4da9-4aed-96ce-4f8d7ead5391"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:26.848074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5cbf50c6-93d8-4ce2-ae01-121fd08733f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:26.852560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:45:26.852560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:45:26.855020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5cbf50c6-93d8-4ce2-ae01-121fd08733f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:26.855613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5cbf50c6-93d8-4ce2-ae01-121fd08733f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:26.856411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5cbf50c6-93d8-4ce2-ae01-121fd08733f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:26.857110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5cbf50c6-93d8-4ce2-ae01-121fd08733f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:26.859699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-f1733e92-1536-4e4a-a878-d4dc2ca73583 req-7135b479-ea28-4804-bf88-3d0dd254307e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:26.860213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-f1733e92-1536-4e4a-a878-d4dc2ca73583 req-7135b479-ea28-4804-bf88-3d0dd254307e service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:26.871479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-f1733e92-1536-4e4a-a878-d4dc2ca73583 req-7135b479-ea28-4804-bf88-3d0dd254307e service nova] Creating event network-changed:9997c77e-4da9-4aed-96ce-4f8d7ead5391 for instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 on hv-cinder-82002 Dec 15 16:45:26.876533 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-f1733e92-1536-4e4a-a878-d4dc2ca73583 req-7135b479-ea28-4804-bf88-3d0dd254307e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033223 Dec 15 16:45:26.877403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1318/2422] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:45:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:45:26.919374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5cbf50c6-93d8-4ce2-ae01-121fd08733f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 14 microversion: 2.20 time: 0.081570 Dec 15 16:45:26.923062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1105/2423] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:26 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:27.209416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1eaa67dd-6911-461b-91c9-c42b1c12f533 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:27.210628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1eaa67dd-6911-461b-91c9-c42b1c12f533 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:27.217036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1eaa67dd-6911-461b-91c9-c42b1c12f533 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:27.217556 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1eaa67dd-6911-461b-91c9-c42b1c12f533 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:27.218352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1eaa67dd-6911-461b-91c9-c42b1c12f533 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:27.219150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1eaa67dd-6911-461b-91c9-c42b1c12f533 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:27.332140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e76ec343-cc3c-42cc-994c-40b0cadd4dc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:27.332879 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e76ec343-cc3c-42cc-994c-40b0cadd4dc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:27.339741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e76ec343-cc3c-42cc-994c-40b0cadd4dc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:27.340237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e76ec343-cc3c-42cc-994c-40b0cadd4dc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:27.341032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e76ec343-cc3c-42cc-994c-40b0cadd4dc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:27.341451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e76ec343-cc3c-42cc-994c-40b0cadd4dc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:27.456606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e76ec343-cc3c-42cc-994c-40b0cadd4dc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:27.465641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e76ec343-cc3c-42cc-994c-40b0cadd4dc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.137973 Dec 15 16:45:27.466144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1106/2424] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:27 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:27.498363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1eaa67dd-6911-461b-91c9-c42b1c12f533 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:27.506738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1eaa67dd-6911-461b-91c9-c42b1c12f533 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.301499 Dec 15 16:45:27.507316 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1319/2425] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:27 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:27.931432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-578cae95-0e36-448e-bddf-37ba7cd2c8ab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:27.932333 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-578cae95-0e36-448e-bddf-37ba7cd2c8ab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:27.939278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-578cae95-0e36-448e-bddf-37ba7cd2c8ab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:27.939728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-578cae95-0e36-448e-bddf-37ba7cd2c8ab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:27.940957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-578cae95-0e36-448e-bddf-37ba7cd2c8ab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:27.941084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-578cae95-0e36-448e-bddf-37ba7cd2c8ab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:27.998140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-578cae95-0e36-448e-bddf-37ba7cd2c8ab tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 14 microversion: 2.20 time: 0.070411 Dec 15 16:45:27.998651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1107/2426] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:27 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:28.484261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-17d2447b-f68f-4e46-af09-ab93018f2adb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:28.485007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-17d2447b-f68f-4e46-af09-ab93018f2adb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:28.492137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17d2447b-f68f-4e46-af09-ab93018f2adb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:28.492630 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17d2447b-f68f-4e46-af09-ab93018f2adb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:28.493408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17d2447b-f68f-4e46-af09-ab93018f2adb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:28.493843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17d2447b-f68f-4e46-af09-ab93018f2adb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:28.523645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f768d5ed-bfa9-4cc9-8684-d40ff50af52c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:28.524361 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f768d5ed-bfa9-4cc9-8684-d40ff50af52c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:28.531573 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f768d5ed-bfa9-4cc9-8684-d40ff50af52c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:28.532017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f768d5ed-bfa9-4cc9-8684-d40ff50af52c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:28.532839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f768d5ed-bfa9-4cc9-8684-d40ff50af52c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:28.533267 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f768d5ed-bfa9-4cc9-8684-d40ff50af52c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:28.554269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-17d2447b-f68f-4e46-af09-ab93018f2adb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:28.563138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-17d2447b-f68f-4e46-af09-ab93018f2adb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.082168 Dec 15 16:45:28.563707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1320/2427] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:28.672068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f768d5ed-bfa9-4cc9-8684-d40ff50af52c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:28.684180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f768d5ed-bfa9-4cc9-8684-d40ff50af52c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164273 Dec 15 16:45:28.685059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1108/2428] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:28 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:29.009034 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f6a7002f-c953-4587-8021-c2422299cb4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:29.009989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f6a7002f-c953-4587-8021-c2422299cb4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:29.016581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f6a7002f-c953-4587-8021-c2422299cb4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:29.017024 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f6a7002f-c953-4587-8021-c2422299cb4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:29.017818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f6a7002f-c953-4587-8021-c2422299cb4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:29.018245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f6a7002f-c953-4587-8021-c2422299cb4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:29.077639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f6a7002f-c953-4587-8021-c2422299cb4a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 14 microversion: 2.20 time: 0.072280 Dec 15 16:45:29.078254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1321/2429] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:29 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:29.584248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c671db66-c020-497e-8906-534104118f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:29.585410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c671db66-c020-497e-8906-534104118f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:29.596363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c671db66-c020-497e-8906-534104118f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:29.597164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c671db66-c020-497e-8906-534104118f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:29.598443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c671db66-c020-497e-8906-534104118f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:29.599168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c671db66-c020-497e-8906-534104118f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:29.670826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c671db66-c020-497e-8906-534104118f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:29.679237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c671db66-c020-497e-8906-534104118f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.101418 Dec 15 16:45:29.679819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1109/2430] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:29.702057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c30d6d34-00d4-433b-9a89-29bb7433f016 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:29.702777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c30d6d34-00d4-433b-9a89-29bb7433f016 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:29.710407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c30d6d34-00d4-433b-9a89-29bb7433f016 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:29.710861 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c30d6d34-00d4-433b-9a89-29bb7433f016 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:29.711641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c30d6d34-00d4-433b-9a89-29bb7433f016 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:29.712073 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c30d6d34-00d4-433b-9a89-29bb7433f016 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:29.847760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c30d6d34-00d4-433b-9a89-29bb7433f016 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:29.855654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c30d6d34-00d4-433b-9a89-29bb7433f016 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.157683 Dec 15 16:45:29.856238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1322/2431] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:29 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:30.092873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e54b510d-f933-4bf5-9a90-aa6481968115 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:30.094678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e54b510d-f933-4bf5-9a90-aa6481968115 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:30.102585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e54b510d-f933-4bf5-9a90-aa6481968115 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:30.102961 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e54b510d-f933-4bf5-9a90-aa6481968115 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:30.103745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e54b510d-f933-4bf5-9a90-aa6481968115 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:30.104171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e54b510d-f933-4bf5-9a90-aa6481968115 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:30.171645 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e54b510d-f933-4bf5-9a90-aa6481968115 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 14 microversion: 2.20 time: 0.084663 Dec 15 16:45:30.172509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1110/2432] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:30 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:30.696627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-99617604-d665-429e-b33b-453b5c5b1e36 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:30.697236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-99617604-d665-429e-b33b-453b5c5b1e36 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:30.703898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99617604-d665-429e-b33b-453b5c5b1e36 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:30.704547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99617604-d665-429e-b33b-453b5c5b1e36 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:30.705133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99617604-d665-429e-b33b-453b5c5b1e36 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:30.705586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99617604-d665-429e-b33b-453b5c5b1e36 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:30.770232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-99617604-d665-429e-b33b-453b5c5b1e36 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:30.782055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-99617604-d665-429e-b33b-453b5c5b1e36 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089005 Dec 15 16:45:30.782726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1323/2433] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:30.879056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-16ed22f9-1888-40d7-9a13-dd76f6e36b2a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:30.879882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-16ed22f9-1888-40d7-9a13-dd76f6e36b2a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:30.888977 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16ed22f9-1888-40d7-9a13-dd76f6e36b2a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:30.889424 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16ed22f9-1888-40d7-9a13-dd76f6e36b2a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:30.890214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16ed22f9-1888-40d7-9a13-dd76f6e36b2a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:30.890644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-16ed22f9-1888-40d7-9a13-dd76f6e36b2a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:31.028229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-16ed22f9-1888-40d7-9a13-dd76f6e36b2a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:31.038400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-16ed22f9-1888-40d7-9a13-dd76f6e36b2a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167485 Dec 15 16:45:31.039031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1111/2434] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:30 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:31.191595 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b2e5317d-04fb-4501-97ed-580b3350edb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:31.192855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b2e5317d-04fb-4501-97ed-580b3350edb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:31.201013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b2e5317d-04fb-4501-97ed-580b3350edb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:31.201470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b2e5317d-04fb-4501-97ed-580b3350edb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:31.202253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b2e5317d-04fb-4501-97ed-580b3350edb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:31.202688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b2e5317d-04fb-4501-97ed-580b3350edb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:31.266255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b2e5317d-04fb-4501-97ed-580b3350edb2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 14 microversion: 2.20 time: 0.085002 Dec 15 16:45:31.266857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1324/2435] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:31 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:31.803316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-37443cbf-eb64-4268-9473-9b6e4af345cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:31.804341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-37443cbf-eb64-4268-9473-9b6e4af345cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:31.814958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37443cbf-eb64-4268-9473-9b6e4af345cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:31.815814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37443cbf-eb64-4268-9473-9b6e4af345cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:31.816639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37443cbf-eb64-4268-9473-9b6e4af345cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:31.817068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-37443cbf-eb64-4268-9473-9b6e4af345cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:31.889359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-37443cbf-eb64-4268-9473-9b6e4af345cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:31.897681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-37443cbf-eb64-4268-9473-9b6e4af345cf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.100521 Dec 15 16:45:31.898254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1112/2436] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:32.059346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9dc7129c-5963-43a6-893e-72d3b9dca0a8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:32.060203 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9dc7129c-5963-43a6-893e-72d3b9dca0a8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:32.070114 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dc7129c-5963-43a6-893e-72d3b9dca0a8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:32.070717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dc7129c-5963-43a6-893e-72d3b9dca0a8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:32.071772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dc7129c-5963-43a6-893e-72d3b9dca0a8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:32.072348 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9dc7129c-5963-43a6-893e-72d3b9dca0a8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:32.223552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9dc7129c-5963-43a6-893e-72d3b9dca0a8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:32.238193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9dc7129c-5963-43a6-893e-72d3b9dca0a8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.181942 Dec 15 16:45:32.241439 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1325/2437] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:32 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:32.278076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-25c5b115-a056-4448-9065-a6c1b9aaae99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:32.278988 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-25c5b115-a056-4448-9065-a6c1b9aaae99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:32.285557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25c5b115-a056-4448-9065-a6c1b9aaae99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:32.286002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25c5b115-a056-4448-9065-a6c1b9aaae99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:32.286776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25c5b115-a056-4448-9065-a6c1b9aaae99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:32.287203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25c5b115-a056-4448-9065-a6c1b9aaae99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:32.342822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-25c5b115-a056-4448-9065-a6c1b9aaae99 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 14 microversion: 2.20 time: 0.068487 Dec 15 16:45:32.343414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1113/2438] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:32 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:32.918680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e401ba3-0904-4890-86c9-4b969bb7aa96 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:32.919697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1e401ba3-0904-4890-86c9-4b969bb7aa96 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:32.928471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e401ba3-0904-4890-86c9-4b969bb7aa96 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:32.928963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e401ba3-0904-4890-86c9-4b969bb7aa96 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:32.929749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e401ba3-0904-4890-86c9-4b969bb7aa96 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:32.930194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1e401ba3-0904-4890-86c9-4b969bb7aa96 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:32.995642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1e401ba3-0904-4890-86c9-4b969bb7aa96 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:33.004236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1e401ba3-0904-4890-86c9-4b969bb7aa96 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091734 Dec 15 16:45:33.004824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1326/2439] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:33.263194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-92310022-1e13-4485-92c1-de9e6f59655f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:33.264512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-92310022-1e13-4485-92c1-de9e6f59655f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:33.284054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92310022-1e13-4485-92c1-de9e6f59655f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:33.284890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92310022-1e13-4485-92c1-de9e6f59655f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:33.285697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92310022-1e13-4485-92c1-de9e6f59655f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:33.286133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-92310022-1e13-4485-92c1-de9e6f59655f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:33.354301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5b4f09c5-929f-462a-a32c-c305f750f920 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:33.355222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5b4f09c5-929f-462a-a32c-c305f750f920 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:33.362007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b4f09c5-929f-462a-a32c-c305f750f920 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:33.362441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b4f09c5-929f-462a-a32c-c305f750f920 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:33.363320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b4f09c5-929f-462a-a32c-c305f750f920 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:33.363790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b4f09c5-929f-462a-a32c-c305f750f920 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:33.425768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5b4f09c5-929f-462a-a32c-c305f750f920 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 14 microversion: 2.20 time: 0.074960 Dec 15 16:45:33.429104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1327/2440] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:33 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:33.429374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-92310022-1e13-4485-92c1-de9e6f59655f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:33.440662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-92310022-1e13-4485-92c1-de9e6f59655f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.184001 Dec 15 16:45:33.441313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1114/2441] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:33 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:34.026667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-946b96cc-0b2e-4d02-8054-5e21e71f108f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:34.027811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-946b96cc-0b2e-4d02-8054-5e21e71f108f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:34.037604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-946b96cc-0b2e-4d02-8054-5e21e71f108f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:34.038057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-946b96cc-0b2e-4d02-8054-5e21e71f108f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:34.038841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-946b96cc-0b2e-4d02-8054-5e21e71f108f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:34.039278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-946b96cc-0b2e-4d02-8054-5e21e71f108f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:34.100863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-946b96cc-0b2e-4d02-8054-5e21e71f108f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:34.109329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-946b96cc-0b2e-4d02-8054-5e21e71f108f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089517 Dec 15 16:45:34.109904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1328/2442] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:34.436465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c8719446-ce33-4124-8861-6fa02dd0af0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:34.437440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c8719446-ce33-4124-8861-6fa02dd0af0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:34.444042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8719446-ce33-4124-8861-6fa02dd0af0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:34.444530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8719446-ce33-4124-8861-6fa02dd0af0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:34.445327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8719446-ce33-4124-8861-6fa02dd0af0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:34.445767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c8719446-ce33-4124-8861-6fa02dd0af0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:34.461467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f47b6069-85d5-423a-bc13-595fd643b4ba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:34.462140 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f47b6069-85d5-423a-bc13-595fd643b4ba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:34.468781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f47b6069-85d5-423a-bc13-595fd643b4ba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:34.469592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f47b6069-85d5-423a-bc13-595fd643b4ba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:34.470374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f47b6069-85d5-423a-bc13-595fd643b4ba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:34.470829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f47b6069-85d5-423a-bc13-595fd643b4ba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:34.537281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c8719446-ce33-4124-8861-6fa02dd0af0d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 14 microversion: 2.20 time: 0.104258 Dec 15 16:45:34.537915 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1115/2443] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:34 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:34.612958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f47b6069-85d5-423a-bc13-595fd643b4ba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:34.622783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f47b6069-85d5-423a-bc13-595fd643b4ba tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164940 Dec 15 16:45:34.623351 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1329/2444] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:34 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:35.127450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-46d973a3-ed4a-4862-944e-3ea1dbb70b7b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:35.128175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-46d973a3-ed4a-4862-944e-3ea1dbb70b7b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:35.135478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46d973a3-ed4a-4862-944e-3ea1dbb70b7b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:35.135928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46d973a3-ed4a-4862-944e-3ea1dbb70b7b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:35.136732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46d973a3-ed4a-4862-944e-3ea1dbb70b7b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:35.137396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-46d973a3-ed4a-4862-944e-3ea1dbb70b7b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:35.233618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-46d973a3-ed4a-4862-944e-3ea1dbb70b7b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:35.241775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-46d973a3-ed4a-4862-944e-3ea1dbb70b7b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.118386 Dec 15 16:45:35.242380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1116/2445] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:35.547768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-62e2e1bc-3e26-443d-842e-a4a50f8731e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:35.548822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-62e2e1bc-3e26-443d-842e-a4a50f8731e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:35.555504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62e2e1bc-3e26-443d-842e-a4a50f8731e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:35.555953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62e2e1bc-3e26-443d-842e-a4a50f8731e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:35.556873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62e2e1bc-3e26-443d-842e-a4a50f8731e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:35.557359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-62e2e1bc-3e26-443d-842e-a4a50f8731e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:35.615774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-591bedd8-69eb-4bf5-9334-f230132c2e0f req-30c58f12-e235-4b91-9e06-e9a8c8c61cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134cc886-afce-4a89-b875-cdf6768bfd8f", "name": "network-vif-deleted", "tag": "9b8f6012-13ef-4292-8d62-47854410ace5"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:35.617310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:45:35.617310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:45:35.625578 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-62e2e1bc-3e26-443d-842e-a4a50f8731e3 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 14 microversion: 2.20 time: 0.081315 Dec 15 16:45:35.626289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-591bedd8-69eb-4bf5-9334-f230132c2e0f req-30c58f12-e235-4b91-9e06-e9a8c8c61cb5 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:35.626434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1330/2446] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:35 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:35.626540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-591bedd8-69eb-4bf5-9334-f230132c2e0f req-30c58f12-e235-4b91-9e06-e9a8c8c61cb5 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:35.640205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-591bedd8-69eb-4bf5-9334-f230132c2e0f req-30c58f12-e235-4b91-9e06-e9a8c8c61cb5 service nova] Creating event network-vif-deleted:9b8f6012-13ef-4292-8d62-47854410ace5 for instance 134cc886-afce-4a89-b875-cdf6768bfd8f on hv-cinder-82002 Dec 15 16:45:35.642717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6c38765a-962c-4af1-b8c4-0ce90761d593 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:35.643411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6c38765a-962c-4af1-b8c4-0ce90761d593 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:35.646310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-591bedd8-69eb-4bf5-9334-f230132c2e0f req-30c58f12-e235-4b91-9e06-e9a8c8c61cb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034168 Dec 15 16:45:35.647088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1117/2447] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:45:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:45:35.650737 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c38765a-962c-4af1-b8c4-0ce90761d593 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:35.651184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c38765a-962c-4af1-b8c4-0ce90761d593 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:35.651982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c38765a-962c-4af1-b8c4-0ce90761d593 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:35.652403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6c38765a-962c-4af1-b8c4-0ce90761d593 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:35.785435 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6c38765a-962c-4af1-b8c4-0ce90761d593 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:35.793779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6c38765a-962c-4af1-b8c4-0ce90761d593 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.155044 Dec 15 16:45:35.794342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1331/2448] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:35 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:36.261939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-64cf1715-13fa-4be8-9453-dfcfbeb0a428 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:36.262687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-64cf1715-13fa-4be8-9453-dfcfbeb0a428 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:36.269862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64cf1715-13fa-4be8-9453-dfcfbeb0a428 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:36.270328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64cf1715-13fa-4be8-9453-dfcfbeb0a428 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:36.271139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64cf1715-13fa-4be8-9453-dfcfbeb0a428 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:36.271591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64cf1715-13fa-4be8-9453-dfcfbeb0a428 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:36.338669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-64cf1715-13fa-4be8-9453-dfcfbeb0a428 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:36.347632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-64cf1715-13fa-4be8-9453-dfcfbeb0a428 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089966 Dec 15 16:45:36.348221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1118/2449] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:36.640766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7a62b39d-59e7-41fa-94bd-86e8ee73ad6c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:36.642217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7a62b39d-59e7-41fa-94bd-86e8ee73ad6c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:36.649377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a62b39d-59e7-41fa-94bd-86e8ee73ad6c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:36.649816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a62b39d-59e7-41fa-94bd-86e8ee73ad6c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:36.650582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a62b39d-59e7-41fa-94bd-86e8ee73ad6c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:36.651015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a62b39d-59e7-41fa-94bd-86e8ee73ad6c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:36.725490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7a62b39d-59e7-41fa-94bd-86e8ee73ad6c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 9709 microversion: 2.20 time: 0.090910 Dec 15 16:45:36.726124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1332/2450] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:36 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 9709 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:45:36.814907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e31dccfa-d3ca-4fb3-b664-4f5cb9f586a3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:36.815868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e31dccfa-d3ca-4fb3-b664-4f5cb9f586a3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:36.822834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e31dccfa-d3ca-4fb3-b664-4f5cb9f586a3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:36.823284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e31dccfa-d3ca-4fb3-b664-4f5cb9f586a3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:36.824053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e31dccfa-d3ca-4fb3-b664-4f5cb9f586a3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:36.824486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e31dccfa-d3ca-4fb3-b664-4f5cb9f586a3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:36.959708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e31dccfa-d3ca-4fb3-b664-4f5cb9f586a3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:36.969633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e31dccfa-d3ca-4fb3-b664-4f5cb9f586a3 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.160515 Dec 15 16:45:36.970203 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1119/2451] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:36 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:37.369663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a267e29d-5c77-43ee-9eb3-69b0f883d983 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:37.370871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a267e29d-5c77-43ee-9eb3-69b0f883d983 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:37.382375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a267e29d-5c77-43ee-9eb3-69b0f883d983 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:37.383109 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a267e29d-5c77-43ee-9eb3-69b0f883d983 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:37.384360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a267e29d-5c77-43ee-9eb3-69b0f883d983 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:37.385150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a267e29d-5c77-43ee-9eb3-69b0f883d983 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:37.451717 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a267e29d-5c77-43ee-9eb3-69b0f883d983 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:37.460735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a267e29d-5c77-43ee-9eb3-69b0f883d983 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098001 Dec 15 16:45:37.461303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1333/2452] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:37.741789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a5d36f89-f493-4ad7-8108-65507f43e096 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:37.743146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a5d36f89-f493-4ad7-8108-65507f43e096 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:37.754007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a5d36f89-f493-4ad7-8108-65507f43e096 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:37.754747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a5d36f89-f493-4ad7-8108-65507f43e096 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:37.755542 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a5d36f89-f493-4ad7-8108-65507f43e096 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:37.756011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a5d36f89-f493-4ad7-8108-65507f43e096 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:37.829107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a5d36f89-f493-4ad7-8108-65507f43e096 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 17250 microversion: 2.20 time: 0.093691 Dec 15 16:45:37.830239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1120/2453] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:37 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 17250 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:37.989902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-58ed1c5f-3662-473f-a6db-5210842fd526 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:37.990578 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-58ed1c5f-3662-473f-a6db-5210842fd526 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:37.998065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-58ed1c5f-3662-473f-a6db-5210842fd526 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:37.998522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-58ed1c5f-3662-473f-a6db-5210842fd526 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:37.999396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-58ed1c5f-3662-473f-a6db-5210842fd526 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:37.999877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-58ed1c5f-3662-473f-a6db-5210842fd526 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:38.143084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-58ed1c5f-3662-473f-a6db-5210842fd526 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:38.151669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-58ed1c5f-3662-473f-a6db-5210842fd526 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167668 Dec 15 16:45:38.152218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1334/2454] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:37 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:38.479232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ba47a0c1-09ba-4a19-95cf-d0ff90eac37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:38.479959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ba47a0c1-09ba-4a19-95cf-d0ff90eac37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:38.487103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba47a0c1-09ba-4a19-95cf-d0ff90eac37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:38.487548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba47a0c1-09ba-4a19-95cf-d0ff90eac37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:38.488355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba47a0c1-09ba-4a19-95cf-d0ff90eac37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:38.488812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ba47a0c1-09ba-4a19-95cf-d0ff90eac37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:38.560199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ba47a0c1-09ba-4a19-95cf-d0ff90eac37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:38.569369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ba47a0c1-09ba-4a19-95cf-d0ff90eac37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094593 Dec 15 16:45:38.569918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1121/2455] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:38.848382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d82fffe7-5d8d-425c-ada3-8340035a3d6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:38.850187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d82fffe7-5d8d-425c-ada3-8340035a3d6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:38.861128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d82fffe7-5d8d-425c-ada3-8340035a3d6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:38.861846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d82fffe7-5d8d-425c-ada3-8340035a3d6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:38.863128 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d82fffe7-5d8d-425c-ada3-8340035a3d6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:38.863903 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d82fffe7-5d8d-425c-ada3-8340035a3d6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:38.946143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d82fffe7-5d8d-425c-ada3-8340035a3d6e tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 18449 microversion: 2.20 time: 0.104174 Dec 15 16:45:38.947155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1335/2456] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:38 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 18449 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:39.173073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a99c84ff-2ead-4237-9b88-02a4126c9280 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:39.174092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a99c84ff-2ead-4237-9b88-02a4126c9280 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:39.185091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a99c84ff-2ead-4237-9b88-02a4126c9280 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:39.185847 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a99c84ff-2ead-4237-9b88-02a4126c9280 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:39.187190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a99c84ff-2ead-4237-9b88-02a4126c9280 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:39.189057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a99c84ff-2ead-4237-9b88-02a4126c9280 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:39.341222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a99c84ff-2ead-4237-9b88-02a4126c9280 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:39.351884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a99c84ff-2ead-4237-9b88-02a4126c9280 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.185002 Dec 15 16:45:39.352476 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1122/2457] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:39 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:39.596844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0f39c3a4-99f0-4389-9b04-9a278bdb02b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:39.598060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0f39c3a4-99f0-4389-9b04-9a278bdb02b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:39.609421 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f39c3a4-99f0-4389-9b04-9a278bdb02b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:39.610156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f39c3a4-99f0-4389-9b04-9a278bdb02b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:39.611431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f39c3a4-99f0-4389-9b04-9a278bdb02b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:39.612143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0f39c3a4-99f0-4389-9b04-9a278bdb02b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:39.676091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0f39c3a4-99f0-4389-9b04-9a278bdb02b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:39.687522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0f39c3a4-99f0-4389-9b04-9a278bdb02b6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097891 Dec 15 16:45:39.688132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1336/2458] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:39 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:39.963805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-89c1a37a-91ed-469e-8410-213954799905 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:39.965205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-89c1a37a-91ed-469e-8410-213954799905 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:39.975073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-89c1a37a-91ed-469e-8410-213954799905 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:39.975527 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-89c1a37a-91ed-469e-8410-213954799905 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:39.976313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-89c1a37a-91ed-469e-8410-213954799905 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:39.976784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-89c1a37a-91ed-469e-8410-213954799905 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:40.050485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-89c1a37a-91ed-469e-8410-213954799905 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 21226 microversion: 2.20 time: 0.092479 Dec 15 16:45:40.051371 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1123/2459] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:39 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 21226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:40.373069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-18178ddf-2306-4dcb-9622-bfc87ebd39e1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:40.374075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-18178ddf-2306-4dcb-9622-bfc87ebd39e1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:40.385050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18178ddf-2306-4dcb-9622-bfc87ebd39e1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:40.385804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18178ddf-2306-4dcb-9622-bfc87ebd39e1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:40.387084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18178ddf-2306-4dcb-9622-bfc87ebd39e1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:40.387808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-18178ddf-2306-4dcb-9622-bfc87ebd39e1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:40.524814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-18178ddf-2306-4dcb-9622-bfc87ebd39e1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:40.533341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-18178ddf-2306-4dcb-9622-bfc87ebd39e1 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166499 Dec 15 16:45:40.533911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1337/2460] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:40 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:40.704762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5b3dc2c7-7167-4a25-ade7-ee85061c8425 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:40.705350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5b3dc2c7-7167-4a25-ade7-ee85061c8425 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:40.712776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b3dc2c7-7167-4a25-ade7-ee85061c8425 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:40.713219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b3dc2c7-7167-4a25-ade7-ee85061c8425 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:40.713991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b3dc2c7-7167-4a25-ade7-ee85061c8425 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:40.714386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5b3dc2c7-7167-4a25-ade7-ee85061c8425 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:40.775778 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5b3dc2c7-7167-4a25-ade7-ee85061c8425 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:40.784091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5b3dc2c7-7167-4a25-ade7-ee85061c8425 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083577 Dec 15 16:45:40.784685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1124/2461] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:41.066773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-32c4868f-93d1-43d8-89ac-6eca23933eea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:41.068257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-32c4868f-93d1-43d8-89ac-6eca23933eea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:41.078980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32c4868f-93d1-43d8-89ac-6eca23933eea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:41.079736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32c4868f-93d1-43d8-89ac-6eca23933eea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:41.081085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32c4868f-93d1-43d8-89ac-6eca23933eea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:41.081813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-32c4868f-93d1-43d8-89ac-6eca23933eea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:41.153481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-32c4868f-93d1-43d8-89ac-6eca23933eea tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 23045 microversion: 2.20 time: 0.092985 Dec 15 16:45:41.154132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1338/2462] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:41 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 23045 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:41.555516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2e98be91-47e2-45a7-a9f6-7b261c69c62e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:41.556419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2e98be91-47e2-45a7-a9f6-7b261c69c62e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:41.567188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e98be91-47e2-45a7-a9f6-7b261c69c62e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:41.567630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e98be91-47e2-45a7-a9f6-7b261c69c62e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:41.568407 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e98be91-47e2-45a7-a9f6-7b261c69c62e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:41.568868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e98be91-47e2-45a7-a9f6-7b261c69c62e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:41.719398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2e98be91-47e2-45a7-a9f6-7b261c69c62e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:41.728122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2e98be91-47e2-45a7-a9f6-7b261c69c62e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.179404 Dec 15 16:45:41.728699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1125/2463] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:41 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:41.805950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e860b807-e787-4e67-86dc-8db94401219a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:41.806893 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e860b807-e787-4e67-86dc-8db94401219a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:41.817436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e860b807-e787-4e67-86dc-8db94401219a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:41.818136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e860b807-e787-4e67-86dc-8db94401219a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:41.819322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e860b807-e787-4e67-86dc-8db94401219a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:41.819984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e860b807-e787-4e67-86dc-8db94401219a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:41.889520 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e860b807-e787-4e67-86dc-8db94401219a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:41.900138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e860b807-e787-4e67-86dc-8db94401219a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.101213 Dec 15 16:45:41.900753 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1339/2464] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:42.165848 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cd2b624c-f7fc-4fba-915c-de089c939f27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:42.166810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cd2b624c-f7fc-4fba-915c-de089c939f27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:42.173880 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd2b624c-f7fc-4fba-915c-de089c939f27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:42.174347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd2b624c-f7fc-4fba-915c-de089c939f27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:42.175189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd2b624c-f7fc-4fba-915c-de089c939f27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:42.175636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd2b624c-f7fc-4fba-915c-de089c939f27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:42.249432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cd2b624c-f7fc-4fba-915c-de089c939f27 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 24300 microversion: 2.20 time: 0.086890 Dec 15 16:45:42.250266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1126/2465] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:42 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 24300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:42.752852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-724fef4d-b921-48d7-a1b9-d4b7623f5bc9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:42.753847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-724fef4d-b921-48d7-a1b9-d4b7623f5bc9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:42.765053 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-724fef4d-b921-48d7-a1b9-d4b7623f5bc9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:42.765801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-724fef4d-b921-48d7-a1b9-d4b7623f5bc9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:42.767085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-724fef4d-b921-48d7-a1b9-d4b7623f5bc9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:42.767800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-724fef4d-b921-48d7-a1b9-d4b7623f5bc9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:42.897567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-724fef4d-b921-48d7-a1b9-d4b7623f5bc9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:42.905952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-724fef4d-b921-48d7-a1b9-d4b7623f5bc9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.159401 Dec 15 16:45:42.906532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1340/2466] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:42 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:42.917990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f1974eef-54f0-41f5-811f-9e0abe89d29a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:42.918684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f1974eef-54f0-41f5-811f-9e0abe89d29a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:42.925973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1974eef-54f0-41f5-811f-9e0abe89d29a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:42.926508 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1974eef-54f0-41f5-811f-9e0abe89d29a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:42.927314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1974eef-54f0-41f5-811f-9e0abe89d29a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:42.927738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1974eef-54f0-41f5-811f-9e0abe89d29a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:43.000302 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f1974eef-54f0-41f5-811f-9e0abe89d29a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:43.010397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f1974eef-54f0-41f5-811f-9e0abe89d29a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096349 Dec 15 16:45:43.010898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1127/2467] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:43.265479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d4752ff6-9e05-42c7-a038-f9b291451b9b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:43.266858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d4752ff6-9e05-42c7-a038-f9b291451b9b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:43.275404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4752ff6-9e05-42c7-a038-f9b291451b9b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:43.275855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4752ff6-9e05-42c7-a038-f9b291451b9b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:43.276673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4752ff6-9e05-42c7-a038-f9b291451b9b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:43.277110 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d4752ff6-9e05-42c7-a038-f9b291451b9b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:43.352635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d4752ff6-9e05-42c7-a038-f9b291451b9b tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 25965 microversion: 2.20 time: 0.093374 Dec 15 16:45:43.353301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1341/2468] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:43 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 25965 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:43.927041 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8e7791d1-dc07-42c5-902a-8b5307308357 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:43.927636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8e7791d1-dc07-42c5-902a-8b5307308357 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:43.934293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e7791d1-dc07-42c5-902a-8b5307308357 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:43.934737 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e7791d1-dc07-42c5-902a-8b5307308357 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:43.935517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e7791d1-dc07-42c5-902a-8b5307308357 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:43.935941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e7791d1-dc07-42c5-902a-8b5307308357 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:44.027537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f92cf556-88c1-4a10-b277-25aa3ca314d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:44.028368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f92cf556-88c1-4a10-b277-25aa3ca314d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:44.035341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f92cf556-88c1-4a10-b277-25aa3ca314d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:44.035884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f92cf556-88c1-4a10-b277-25aa3ca314d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:44.036897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f92cf556-88c1-4a10-b277-25aa3ca314d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:44.037377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f92cf556-88c1-4a10-b277-25aa3ca314d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:44.070787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8e7791d1-dc07-42c5-902a-8b5307308357 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:44.079228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8e7791d1-dc07-42c5-902a-8b5307308357 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.158372 Dec 15 16:45:44.079852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1128/2469] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:43 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:44.097447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f92cf556-88c1-4a10-b277-25aa3ca314d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:44.105904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f92cf556-88c1-4a10-b277-25aa3ca314d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.082375 Dec 15 16:45:44.106462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1342/2470] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:45:44.369553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-85a86ad1-07c0-44f8-a08b-317e8fd0151c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:44.371023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-85a86ad1-07c0-44f8-a08b-317e8fd0151c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:44.381444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-85a86ad1-07c0-44f8-a08b-317e8fd0151c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:44.381947 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-85a86ad1-07c0-44f8-a08b-317e8fd0151c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:44.382819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-85a86ad1-07c0-44f8-a08b-317e8fd0151c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:44.383306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-85a86ad1-07c0-44f8-a08b-317e8fd0151c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:44.464471 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-85a86ad1-07c0-44f8-a08b-317e8fd0151c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 27227 microversion: 2.20 time: 0.101112 Dec 15 16:45:44.465133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1129/2471] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:44 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 27227 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:45.100133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-841cf317-1eb7-4c52-96c1-2b8108406be6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:45.100803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-841cf317-1eb7-4c52-96c1-2b8108406be6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:45.107544 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-841cf317-1eb7-4c52-96c1-2b8108406be6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:45.107987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-841cf317-1eb7-4c52-96c1-2b8108406be6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:45.108797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-841cf317-1eb7-4c52-96c1-2b8108406be6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:45.109224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-841cf317-1eb7-4c52-96c1-2b8108406be6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:45.122842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6ee3314c-3a3b-46b9-a6b0-fc011eeb853b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:45.123653 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6ee3314c-3a3b-46b9-a6b0-fc011eeb853b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:45.130896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6ee3314c-3a3b-46b9-a6b0-fc011eeb853b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:45.131342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6ee3314c-3a3b-46b9-a6b0-fc011eeb853b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:45.132122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6ee3314c-3a3b-46b9-a6b0-fc011eeb853b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:45.132603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6ee3314c-3a3b-46b9-a6b0-fc011eeb853b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:45.201178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6ee3314c-3a3b-46b9-a6b0-fc011eeb853b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:45.209594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6ee3314c-3a3b-46b9-a6b0-fc011eeb853b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090744 Dec 15 16:45:45.210204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1130/2472] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:45.267853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-841cf317-1eb7-4c52-96c1-2b8108406be6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:45.279821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-841cf317-1eb7-4c52-96c1-2b8108406be6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.185673 Dec 15 16:45:45.280394 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1343/2473] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:45 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:45.480795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b1711184-236c-44e2-891f-48489d2c7119 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:45.482111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b1711184-236c-44e2-891f-48489d2c7119 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:45.491563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1711184-236c-44e2-891f-48489d2c7119 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:45.492007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1711184-236c-44e2-891f-48489d2c7119 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:45.492911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1711184-236c-44e2-891f-48489d2c7119 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:45.493345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b1711184-236c-44e2-891f-48489d2c7119 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:45.577591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b1711184-236c-44e2-891f-48489d2c7119 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 27835 microversion: 2.20 time: 0.102621 Dec 15 16:45:45.578553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1131/2474] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:45 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 27835 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:46.231297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-fc424ffb-c617-4c53-9994-0529ebdf5c6f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:46.232278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-fc424ffb-c617-4c53-9994-0529ebdf5c6f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:46.241652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc424ffb-c617-4c53-9994-0529ebdf5c6f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:46.242104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc424ffb-c617-4c53-9994-0529ebdf5c6f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:46.242869 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc424ffb-c617-4c53-9994-0529ebdf5c6f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:46.243303 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-fc424ffb-c617-4c53-9994-0529ebdf5c6f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:46.300921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cd38635f-6426-428b-a5ed-da7baeb7f586 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:46.301713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cd38635f-6426-428b-a5ed-da7baeb7f586 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:46.309192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd38635f-6426-428b-a5ed-da7baeb7f586 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:46.309379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd38635f-6426-428b-a5ed-da7baeb7f586 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:46.310193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd38635f-6426-428b-a5ed-da7baeb7f586 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:46.310630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cd38635f-6426-428b-a5ed-da7baeb7f586 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:46.311195 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-fc424ffb-c617-4c53-9994-0529ebdf5c6f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:46.319478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-fc424ffb-c617-4c53-9994-0529ebdf5c6f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094288 Dec 15 16:45:46.320022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1344/2475] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:46.591760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f92b1ea1-df2a-4460-af55-9a4f2d6c71b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:46.592695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f92b1ea1-df2a-4460-af55-9a4f2d6c71b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:46.599612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f92b1ea1-df2a-4460-af55-9a4f2d6c71b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:46.600050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f92b1ea1-df2a-4460-af55-9a4f2d6c71b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:46.600868 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f92b1ea1-df2a-4460-af55-9a4f2d6c71b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:46.601295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f92b1ea1-df2a-4460-af55-9a4f2d6c71b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:46.612638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cd38635f-6426-428b-a5ed-da7baeb7f586 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:46.621083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cd38635f-6426-428b-a5ed-da7baeb7f586 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.326761 Dec 15 16:45:46.621659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1132/2476] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:46 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:46.691015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f92b1ea1-df2a-4460-af55-9a4f2d6c71b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 28185 microversion: 2.20 time: 0.102595 Dec 15 16:45:46.692137 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1345/2477] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:46 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 28185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:47.340173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b9e983e3-0ab1-4c75-9ca9-5200a1feffe3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:47.341242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b9e983e3-0ab1-4c75-9ca9-5200a1feffe3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:47.350698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9e983e3-0ab1-4c75-9ca9-5200a1feffe3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:47.351144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9e983e3-0ab1-4c75-9ca9-5200a1feffe3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:47.351921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9e983e3-0ab1-4c75-9ca9-5200a1feffe3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:47.352351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b9e983e3-0ab1-4c75-9ca9-5200a1feffe3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:47.424000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b9e983e3-0ab1-4c75-9ca9-5200a1feffe3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:47.432465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b9e983e3-0ab1-4c75-9ca9-5200a1feffe3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098449 Dec 15 16:45:47.433046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1133/2478] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:47 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:47.643335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-255b628e-b8bf-412c-800f-c41bb5322a75 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:47.644476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-255b628e-b8bf-412c-800f-c41bb5322a75 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:47.656030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-255b628e-b8bf-412c-800f-c41bb5322a75 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:47.656863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-255b628e-b8bf-412c-800f-c41bb5322a75 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:47.658129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-255b628e-b8bf-412c-800f-c41bb5322a75 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:47.658843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-255b628e-b8bf-412c-800f-c41bb5322a75 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:47.704247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ea33d757-b6b0-4492-a1f6-5a404ff18e8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:47.705376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ea33d757-b6b0-4492-a1f6-5a404ff18e8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:47.712190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea33d757-b6b0-4492-a1f6-5a404ff18e8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:47.712668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea33d757-b6b0-4492-a1f6-5a404ff18e8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:47.713455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea33d757-b6b0-4492-a1f6-5a404ff18e8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:47.713881 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea33d757-b6b0-4492-a1f6-5a404ff18e8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:47.780139 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ea33d757-b6b0-4492-a1f6-5a404ff18e8a tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 28185 microversion: 2.20 time: 0.080389 Dec 15 16:45:47.780843 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1134/2479] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:47 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 28185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:47.811683 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-255b628e-b8bf-412c-800f-c41bb5322a75 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:47.820474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-255b628e-b8bf-412c-800f-c41bb5322a75 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.183879 Dec 15 16:45:47.821047 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1346/2480] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:47 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:48.453400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ff292a4d-cf1a-4c39-b421-7ecf4dee0319 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:48.453987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ff292a4d-cf1a-4c39-b421-7ecf4dee0319 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:48.462770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff292a4d-cf1a-4c39-b421-7ecf4dee0319 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:48.463219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff292a4d-cf1a-4c39-b421-7ecf4dee0319 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:48.464001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff292a4d-cf1a-4c39-b421-7ecf4dee0319 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:48.464449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff292a4d-cf1a-4c39-b421-7ecf4dee0319 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:48.615563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ff292a4d-cf1a-4c39-b421-7ecf4dee0319 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:48.624035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ff292a4d-cf1a-4c39-b421-7ecf4dee0319 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.176975 Dec 15 16:45:48.624750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1135/2481] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:48.796056 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-395b3313-f4b9-4bd4-81a5-31e7e5a81960 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:48.797453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-395b3313-f4b9-4bd4-81a5-31e7e5a81960 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:48.808217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-395b3313-f4b9-4bd4-81a5-31e7e5a81960 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:48.809022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-395b3313-f4b9-4bd4-81a5-31e7e5a81960 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:48.810302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-395b3313-f4b9-4bd4-81a5-31e7e5a81960 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:48.811025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-395b3313-f4b9-4bd4-81a5-31e7e5a81960 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:48.845288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0b26413e-3097-4390-b34e-235f63d5c88b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:48.845895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0b26413e-3097-4390-b34e-235f63d5c88b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:48.852789 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b26413e-3097-4390-b34e-235f63d5c88b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:48.853231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b26413e-3097-4390-b34e-235f63d5c88b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:48.854005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b26413e-3097-4390-b34e-235f63d5c88b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:48.854432 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b26413e-3097-4390-b34e-235f63d5c88b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:48.887846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-395b3313-f4b9-4bd4-81a5-31e7e5a81960 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 28476 microversion: 2.20 time: 0.097979 Dec 15 16:45:48.888423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1347/2482] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:48 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 28476 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:48.999499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0b26413e-3097-4390-b34e-235f63d5c88b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:49.007869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0b26413e-3097-4390-b34e-235f63d5c88b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166646 Dec 15 16:45:49.008535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1136/2483] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:48 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:49.651084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f717111e-4fb0-4dd2-bb47-f0828fe0da6d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:49.652260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f717111e-4fb0-4dd2-bb47-f0828fe0da6d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:49.664727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f717111e-4fb0-4dd2-bb47-f0828fe0da6d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:49.665341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f717111e-4fb0-4dd2-bb47-f0828fe0da6d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:49.666411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f717111e-4fb0-4dd2-bb47-f0828fe0da6d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:49.667006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f717111e-4fb0-4dd2-bb47-f0828fe0da6d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:49.741183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f717111e-4fb0-4dd2-bb47-f0828fe0da6d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:49.749841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f717111e-4fb0-4dd2-bb47-f0828fe0da6d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.105848 Dec 15 16:45:49.750434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1348/2484] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:49.904140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8e06ce3c-2bc3-4bb1-a635-5a4d2be7a7d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:49.905089 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8e06ce3c-2bc3-4bb1-a635-5a4d2be7a7d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:49.914794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e06ce3c-2bc3-4bb1-a635-5a4d2be7a7d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:49.915391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e06ce3c-2bc3-4bb1-a635-5a4d2be7a7d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:49.916580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e06ce3c-2bc3-4bb1-a635-5a4d2be7a7d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:49.917146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e06ce3c-2bc3-4bb1-a635-5a4d2be7a7d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:49.999001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8e06ce3c-2bc3-4bb1-a635-5a4d2be7a7d2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 28644 microversion: 2.20 time: 0.101131 Dec 15 16:45:49.999997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1137/2485] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:49 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 28644 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:50.026293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c501b343-0ea7-4e82-8328-09b841f8b51d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:50.026860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c501b343-0ea7-4e82-8328-09b841f8b51d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:50.033726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c501b343-0ea7-4e82-8328-09b841f8b51d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:50.034171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c501b343-0ea7-4e82-8328-09b841f8b51d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:50.034942 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c501b343-0ea7-4e82-8328-09b841f8b51d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:50.035370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c501b343-0ea7-4e82-8328-09b841f8b51d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:50.167976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c501b343-0ea7-4e82-8328-09b841f8b51d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:50.175986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c501b343-0ea7-4e82-8328-09b841f8b51d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.153506 Dec 15 16:45:50.176576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1349/2486] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:50 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:50.774186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-25f408ff-dcf0-4ad8-804f-b402157fb53e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:50.774892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-25f408ff-dcf0-4ad8-804f-b402157fb53e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:50.782328 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25f408ff-dcf0-4ad8-804f-b402157fb53e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:50.782780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25f408ff-dcf0-4ad8-804f-b402157fb53e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:50.783572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25f408ff-dcf0-4ad8-804f-b402157fb53e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:50.784007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-25f408ff-dcf0-4ad8-804f-b402157fb53e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:50.856069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-25f408ff-dcf0-4ad8-804f-b402157fb53e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:50.868935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-25f408ff-dcf0-4ad8-804f-b402157fb53e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.100347 Dec 15 16:45:50.869918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1138/2487] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:51.015216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-472c425f-054c-4abd-b0c6-21dc2e70b2c6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:51.016700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-472c425f-054c-4abd-b0c6-21dc2e70b2c6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:51.022972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-472c425f-054c-4abd-b0c6-21dc2e70b2c6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:51.023440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-472c425f-054c-4abd-b0c6-21dc2e70b2c6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:51.024301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-472c425f-054c-4abd-b0c6-21dc2e70b2c6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:51.024778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-472c425f-054c-4abd-b0c6-21dc2e70b2c6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:51.093247 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-472c425f-054c-4abd-b0c6-21dc2e70b2c6 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 28644 microversion: 2.20 time: 0.082499 Dec 15 16:45:51.094663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1350/2488] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:51 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 28644 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:51.193686 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-225c2238-ad78-4933-b95c-2cf286439866 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:51.194443 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-225c2238-ad78-4933-b95c-2cf286439866 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:51.201383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-225c2238-ad78-4933-b95c-2cf286439866 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:51.201837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-225c2238-ad78-4933-b95c-2cf286439866 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:51.202639 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-225c2238-ad78-4933-b95c-2cf286439866 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:51.203079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-225c2238-ad78-4933-b95c-2cf286439866 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:51.360349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-225c2238-ad78-4933-b95c-2cf286439866 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:51.368994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-225c2238-ad78-4933-b95c-2cf286439866 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.179459 Dec 15 16:45:51.369565 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1139/2489] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:51 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:51.892071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d95d2bbc-0331-4506-8c53-f99adeb5c073 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:51.893273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d95d2bbc-0331-4506-8c53-f99adeb5c073 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:51.904894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d95d2bbc-0331-4506-8c53-f99adeb5c073 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:51.905647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d95d2bbc-0331-4506-8c53-f99adeb5c073 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:51.906946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d95d2bbc-0331-4506-8c53-f99adeb5c073 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:51.907682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d95d2bbc-0331-4506-8c53-f99adeb5c073 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:51.972591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d95d2bbc-0331-4506-8c53-f99adeb5c073 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:51.981183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d95d2bbc-0331-4506-8c53-f99adeb5c073 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095968 Dec 15 16:45:51.981758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1351/2490] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:52.108321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3d832ab3-2bdf-4622-9949-b1f71564dece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:52.109452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3d832ab3-2bdf-4622-9949-b1f71564dece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:52.117828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d832ab3-2bdf-4622-9949-b1f71564dece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:52.118428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d832ab3-2bdf-4622-9949-b1f71564dece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:52.119484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d832ab3-2bdf-4622-9949-b1f71564dece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:52.120099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d832ab3-2bdf-4622-9949-b1f71564dece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:52.184466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3d832ab3-2bdf-4622-9949-b1f71564dece tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 28644 microversion: 2.20 time: 0.080381 Dec 15 16:45:52.185110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1140/2491] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:52 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 28644 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:52.390194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d22e1030-f2b8-4d08-8d93-1b4561478423 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:52.391232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d22e1030-f2b8-4d08-8d93-1b4561478423 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:52.399779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d22e1030-f2b8-4d08-8d93-1b4561478423 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:52.400226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d22e1030-f2b8-4d08-8d93-1b4561478423 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:52.401029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d22e1030-f2b8-4d08-8d93-1b4561478423 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:52.401457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d22e1030-f2b8-4d08-8d93-1b4561478423 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:52.543243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d22e1030-f2b8-4d08-8d93-1b4561478423 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:52.551192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d22e1030-f2b8-4d08-8d93-1b4561478423 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167150 Dec 15 16:45:52.551763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1352/2492] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:52 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:53.003547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c84a2244-4ac7-4de3-beff-a7689ea6db00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:53.004742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c84a2244-4ac7-4de3-beff-a7689ea6db00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:53.016976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c84a2244-4ac7-4de3-beff-a7689ea6db00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:53.017731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c84a2244-4ac7-4de3-beff-a7689ea6db00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:53.019027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c84a2244-4ac7-4de3-beff-a7689ea6db00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:53.019718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c84a2244-4ac7-4de3-beff-a7689ea6db00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:53.097936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c84a2244-4ac7-4de3-beff-a7689ea6db00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:53.106739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c84a2244-4ac7-4de3-beff-a7689ea6db00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.110102 Dec 15 16:45:53.107303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1141/2493] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:53.200572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4126ce61-efdb-40c6-b2f8-fd31d1b78598 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:53.202124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4126ce61-efdb-40c6-b2f8-fd31d1b78598 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:53.211917 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4126ce61-efdb-40c6-b2f8-fd31d1b78598 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:53.212376 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4126ce61-efdb-40c6-b2f8-fd31d1b78598 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:53.213193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4126ce61-efdb-40c6-b2f8-fd31d1b78598 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:53.213627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4126ce61-efdb-40c6-b2f8-fd31d1b78598 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:53.298799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4126ce61-efdb-40c6-b2f8-fd31d1b78598 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 29370 microversion: 2.20 time: 0.104845 Dec 15 16:45:53.300074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1353/2494] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:53 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 29370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:53.571868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-27dc1fac-cc3c-44ed-99af-6d50f545e186 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:53.572656 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-27dc1fac-cc3c-44ed-99af-6d50f545e186 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:53.580698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27dc1fac-cc3c-44ed-99af-6d50f545e186 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:53.581247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27dc1fac-cc3c-44ed-99af-6d50f545e186 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:53.582211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27dc1fac-cc3c-44ed-99af-6d50f545e186 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:53.582750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-27dc1fac-cc3c-44ed-99af-6d50f545e186 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:53.725438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-27dc1fac-cc3c-44ed-99af-6d50f545e186 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:53.737820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-27dc1fac-cc3c-44ed-99af-6d50f545e186 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.171227 Dec 15 16:45:53.738630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1142/2495] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:53 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:54.129511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-327313df-2c0e-4b2c-8cd0-e15148774391 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:54.130690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-327313df-2c0e-4b2c-8cd0-e15148774391 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:54.138803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-327313df-2c0e-4b2c-8cd0-e15148774391 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:54.139245 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-327313df-2c0e-4b2c-8cd0-e15148774391 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:54.140020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-327313df-2c0e-4b2c-8cd0-e15148774391 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:54.140468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-327313df-2c0e-4b2c-8cd0-e15148774391 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:54.205106 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-327313df-2c0e-4b2c-8cd0-e15148774391 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:54.213531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-327313df-2c0e-4b2c-8cd0-e15148774391 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090842 Dec 15 16:45:54.214094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1354/2496] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:54 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:54.315423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-caba0124-648c-49ba-982f-61ce39d808a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:54.316990 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-caba0124-648c-49ba-982f-61ce39d808a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:54.324811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-caba0124-648c-49ba-982f-61ce39d808a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:54.325255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-caba0124-648c-49ba-982f-61ce39d808a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:54.326039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-caba0124-648c-49ba-982f-61ce39d808a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:54.326465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-caba0124-648c-49ba-982f-61ce39d808a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:54.407090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-caba0124-648c-49ba-982f-61ce39d808a5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 31458 microversion: 2.20 time: 0.097184 Dec 15 16:45:54.407957 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1143/2497] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:54 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 31458 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:54.759333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4cbda283-9672-48e5-9523-5223ef798e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:54.759960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4cbda283-9672-48e5-9523-5223ef798e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:54.767806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cbda283-9672-48e5-9523-5223ef798e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:54.768337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cbda283-9672-48e5-9523-5223ef798e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:54.769314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cbda283-9672-48e5-9523-5223ef798e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:54.769825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4cbda283-9672-48e5-9523-5223ef798e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:54.909933 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4cbda283-9672-48e5-9523-5223ef798e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:54.918312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4cbda283-9672-48e5-9523-5223ef798e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.165020 Dec 15 16:45:54.918886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1355/2498] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:54 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:55.232475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b64ae818-e22d-4f43-b884-7233e2abb434 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:55.233528 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b64ae818-e22d-4f43-b884-7233e2abb434 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:55.245504 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b64ae818-e22d-4f43-b884-7233e2abb434 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:55.245935 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b64ae818-e22d-4f43-b884-7233e2abb434 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:55.246718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b64ae818-e22d-4f43-b884-7233e2abb434 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:55.247155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b64ae818-e22d-4f43-b884-7233e2abb434 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:55.312123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b64ae818-e22d-4f43-b884-7233e2abb434 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:55.320981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b64ae818-e22d-4f43-b884-7233e2abb434 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093084 Dec 15 16:45:55.321628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1144/2499] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:55.425751 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1c3429e2-8cd6-4726-bb00-71f73f85118c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:55.427281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1c3429e2-8cd6-4726-bb00-71f73f85118c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:55.435020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c3429e2-8cd6-4726-bb00-71f73f85118c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:55.435463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c3429e2-8cd6-4726-bb00-71f73f85118c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:55.436242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c3429e2-8cd6-4726-bb00-71f73f85118c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:55.436706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1c3429e2-8cd6-4726-bb00-71f73f85118c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:55.515030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1c3429e2-8cd6-4726-bb00-71f73f85118c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 33171 microversion: 2.20 time: 0.095194 Dec 15 16:45:55.515930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1356/2500] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:55 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 33171 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:55.940201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-49fc00d3-b197-40bf-8a22-13df9d896538 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:55.941259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-49fc00d3-b197-40bf-8a22-13df9d896538 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:55.951992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49fc00d3-b197-40bf-8a22-13df9d896538 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:55.952821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49fc00d3-b197-40bf-8a22-13df9d896538 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:55.954123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49fc00d3-b197-40bf-8a22-13df9d896538 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:55.954870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-49fc00d3-b197-40bf-8a22-13df9d896538 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:56.090162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-49fc00d3-b197-40bf-8a22-13df9d896538 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:56.102441 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-49fc00d3-b197-40bf-8a22-13df9d896538 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168223 Dec 15 16:45:56.103380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1145/2501] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:55 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:56.342963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3614da2f-bf3d-4e13-b7dd-33eab5aac596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:56.343928 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3614da2f-bf3d-4e13-b7dd-33eab5aac596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:56.353901 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3614da2f-bf3d-4e13-b7dd-33eab5aac596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:56.354345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3614da2f-bf3d-4e13-b7dd-33eab5aac596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:56.355120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3614da2f-bf3d-4e13-b7dd-33eab5aac596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:56.355552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3614da2f-bf3d-4e13-b7dd-33eab5aac596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:56.416268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3614da2f-bf3d-4e13-b7dd-33eab5aac596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:56.424599 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3614da2f-bf3d-4e13-b7dd-33eab5aac596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088917 Dec 15 16:45:56.425132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1357/2502] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:56.532771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f66f9abe-afc8-421e-a098-67d0dbfee3bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:56.534224 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f66f9abe-afc8-421e-a098-67d0dbfee3bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:56.543058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f66f9abe-afc8-421e-a098-67d0dbfee3bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:56.543854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f66f9abe-afc8-421e-a098-67d0dbfee3bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:56.545280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f66f9abe-afc8-421e-a098-67d0dbfee3bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:56.546910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f66f9abe-afc8-421e-a098-67d0dbfee3bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:56.624965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f66f9abe-afc8-421e-a098-67d0dbfee3bb tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 34187 microversion: 2.20 time: 0.098204 Dec 15 16:45:56.625521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1146/2503] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:56 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 34187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:57.124057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ba8ee2da-c020-4cde-9029-a26807376271 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:57.125117 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ba8ee2da-c020-4cde-9029-a26807376271 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:57.135013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba8ee2da-c020-4cde-9029-a26807376271 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:57.135472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba8ee2da-c020-4cde-9029-a26807376271 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:57.136250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba8ee2da-c020-4cde-9029-a26807376271 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:57.136733 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ba8ee2da-c020-4cde-9029-a26807376271 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:57.276328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ba8ee2da-c020-4cde-9029-a26807376271 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:57.288322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ba8ee2da-c020-4cde-9029-a26807376271 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170439 Dec 15 16:45:57.289592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1358/2504] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:57 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:57.447166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ef37aff3-f9d3-4fee-bb4a-d2f76f579321 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:57.448175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ef37aff3-f9d3-4fee-bb4a-d2f76f579321 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:57.459559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ef37aff3-f9d3-4fee-bb4a-d2f76f579321 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:57.460308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ef37aff3-f9d3-4fee-bb4a-d2f76f579321 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:57.461724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ef37aff3-f9d3-4fee-bb4a-d2f76f579321 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:57.462039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ef37aff3-f9d3-4fee-bb4a-d2f76f579321 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:57.524376 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ef37aff3-f9d3-4fee-bb4a-d2f76f579321 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:57.532921 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ef37aff3-f9d3-4fee-bb4a-d2f76f579321 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092757 Dec 15 16:45:57.533499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1147/2505] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:57.643042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e1cf3d14-c5a5-49a4-ba9e-0e519e0c75f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:57.644606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e1cf3d14-c5a5-49a4-ba9e-0e519e0c75f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:57.653478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1cf3d14-c5a5-49a4-ba9e-0e519e0c75f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:57.653930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1cf3d14-c5a5-49a4-ba9e-0e519e0c75f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:57.654709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1cf3d14-c5a5-49a4-ba9e-0e519e0c75f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:57.655147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e1cf3d14-c5a5-49a4-ba9e-0e519e0c75f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:57.727116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e1cf3d14-c5a5-49a4-ba9e-0e519e0c75f2 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 35282 microversion: 2.20 time: 0.089860 Dec 15 16:45:57.727969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1359/2506] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:57 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 35282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:58.308958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4c395247-32e9-4eac-93e8-fdf3c5869d6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:58.309607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4c395247-32e9-4eac-93e8-fdf3c5869d6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:58.316566 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c395247-32e9-4eac-93e8-fdf3c5869d6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:58.317010 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c395247-32e9-4eac-93e8-fdf3c5869d6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:58.317826 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c395247-32e9-4eac-93e8-fdf3c5869d6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:58.318284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c395247-32e9-4eac-93e8-fdf3c5869d6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:58.457652 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4c395247-32e9-4eac-93e8-fdf3c5869d6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:58.466098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4c395247-32e9-4eac-93e8-fdf3c5869d6d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161901 Dec 15 16:45:58.466663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1148/2507] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:58 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:58.556795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f004bc1b-1abe-4452-bc95-c5a2c3975db6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:58.557952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f004bc1b-1abe-4452-bc95-c5a2c3975db6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:58.571184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f004bc1b-1abe-4452-bc95-c5a2c3975db6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:58.571975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f004bc1b-1abe-4452-bc95-c5a2c3975db6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:58.573528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f004bc1b-1abe-4452-bc95-c5a2c3975db6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:58.574038 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f004bc1b-1abe-4452-bc95-c5a2c3975db6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:58.647344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f004bc1b-1abe-4452-bc95-c5a2c3975db6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:58.655816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f004bc1b-1abe-4452-bc95-c5a2c3975db6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.108098 Dec 15 16:45:58.656332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1360/2508] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:58.743091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-41b05c70-e2a5-451f-824a-08708013bb47 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:58.744395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-41b05c70-e2a5-451f-824a-08708013bb47 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:58.754638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41b05c70-e2a5-451f-824a-08708013bb47 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:58.755312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41b05c70-e2a5-451f-824a-08708013bb47 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:58.756532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41b05c70-e2a5-451f-824a-08708013bb47 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:58.757235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-41b05c70-e2a5-451f-824a-08708013bb47 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:58.831104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-41b05c70-e2a5-451f-824a-08708013bb47 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 36808 microversion: 2.20 time: 0.093871 Dec 15 16:45:58.832031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1149/2509] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:58 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 36808 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:45:59.487906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ff97e5bf-b47e-44e3-8d88-9346ba0c7a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:59.488887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ff97e5bf-b47e-44e3-8d88-9346ba0c7a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:59.499454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff97e5bf-b47e-44e3-8d88-9346ba0c7a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:59.500241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff97e5bf-b47e-44e3-8d88-9346ba0c7a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:59.501560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff97e5bf-b47e-44e3-8d88-9346ba0c7a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:59.502321 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ff97e5bf-b47e-44e3-8d88-9346ba0c7a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:59.634552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ff97e5bf-b47e-44e3-8d88-9346ba0c7a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:59.646507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ff97e5bf-b47e-44e3-8d88-9346ba0c7a8c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164576 Dec 15 16:45:59.647215 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1361/2510] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:59 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:59.676218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-452e44b8-ed3e-4513-8d56-1da82012ddea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:45:59.676953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-452e44b8-ed3e-4513-8d56-1da82012ddea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:59.684377 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-452e44b8-ed3e-4513-8d56-1da82012ddea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:59.684853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-452e44b8-ed3e-4513-8d56-1da82012ddea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:59.685640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-452e44b8-ed3e-4513-8d56-1da82012ddea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:59.686079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-452e44b8-ed3e-4513-8d56-1da82012ddea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:59.755981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-452e44b8-ed3e-4513-8d56-1da82012ddea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:45:59.764715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-452e44b8-ed3e-4513-8d56-1da82012ddea tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092538 Dec 15 16:45:59.765276 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1150/2511] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:45:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:45:59.852292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ab7bc614-fd77-4ab2-8002-f48146d1c8b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:45:59.854114 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ab7bc614-fd77-4ab2-8002-f48146d1c8b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:45:59.864575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab7bc614-fd77-4ab2-8002-f48146d1c8b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:59.865325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab7bc614-fd77-4ab2-8002-f48146d1c8b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:59.866660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab7bc614-fd77-4ab2-8002-f48146d1c8b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:45:59.867373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ab7bc614-fd77-4ab2-8002-f48146d1c8b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:45:59.945970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ab7bc614-fd77-4ab2-8002-f48146d1c8b8 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 38197 microversion: 2.20 time: 0.101611 Dec 15 16:45:59.946741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1362/2512] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:45:59 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 38197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:46:00.664794 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-149f3cb5-4e7f-4512-89b4-8cd0fce5bbd4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:00.665415 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-149f3cb5-4e7f-4512-89b4-8cd0fce5bbd4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:00.672881 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-149f3cb5-4e7f-4512-89b4-8cd0fce5bbd4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:00.673337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-149f3cb5-4e7f-4512-89b4-8cd0fce5bbd4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:00.674141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-149f3cb5-4e7f-4512-89b4-8cd0fce5bbd4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:00.674581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-149f3cb5-4e7f-4512-89b4-8cd0fce5bbd4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:00.782378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-749ef8f4-1a80-43a2-86dc-53ed1ec18a52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:00.783077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-749ef8f4-1a80-43a2-86dc-53ed1ec18a52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:00.789919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-749ef8f4-1a80-43a2-86dc-53ed1ec18a52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:00.790378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-749ef8f4-1a80-43a2-86dc-53ed1ec18a52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:00.791308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-749ef8f4-1a80-43a2-86dc-53ed1ec18a52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:00.791746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-749ef8f4-1a80-43a2-86dc-53ed1ec18a52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:00.814819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-149f3cb5-4e7f-4512-89b4-8cd0fce5bbd4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:00.825867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-149f3cb5-4e7f-4512-89b4-8cd0fce5bbd4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164812 Dec 15 16:46:00.826426 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1151/2513] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:00 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:00.854846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-749ef8f4-1a80-43a2-86dc-53ed1ec18a52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:00.863523 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-749ef8f4-1a80-43a2-86dc-53ed1ec18a52 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085216 Dec 15 16:46:00.864069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1363/2514] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:00.961090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-871c3763-f2e8-44ee-8f8d-aa1a090469f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:46:00.962392 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-871c3763-f2e8-44ee-8f8d-aa1a090469f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:00.972275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-871c3763-f2e8-44ee-8f8d-aa1a090469f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:00.973031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-871c3763-f2e8-44ee-8f8d-aa1a090469f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:00.974230 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-871c3763-f2e8-44ee-8f8d-aa1a090469f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:00.974900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-871c3763-f2e8-44ee-8f8d-aa1a090469f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:01.039555 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-871c3763-f2e8-44ee-8f8d-aa1a090469f5 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 38197 microversion: 2.20 time: 0.084338 Dec 15 16:46:01.040198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1152/2515] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:46:00 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 38197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:46:01.847899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-41781342-c1aa-4620-a684-6fbd2e87b6ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:01.848882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-41781342-c1aa-4620-a684-6fbd2e87b6ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:01.860055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41781342-c1aa-4620-a684-6fbd2e87b6ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:01.860829 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41781342-c1aa-4620-a684-6fbd2e87b6ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:01.862130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41781342-c1aa-4620-a684-6fbd2e87b6ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:01.862880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41781342-c1aa-4620-a684-6fbd2e87b6ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:01.881636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6da2669e-7058-4e55-a260-5dc020c43e8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:01.882331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6da2669e-7058-4e55-a260-5dc020c43e8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:01.889812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6da2669e-7058-4e55-a260-5dc020c43e8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:01.890256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6da2669e-7058-4e55-a260-5dc020c43e8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:01.891009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6da2669e-7058-4e55-a260-5dc020c43e8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:01.891442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6da2669e-7058-4e55-a260-5dc020c43e8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:01.954113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6da2669e-7058-4e55-a260-5dc020c43e8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:01.962480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6da2669e-7058-4e55-a260-5dc020c43e8f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085264 Dec 15 16:46:01.963191 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1153/2516] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:02.027935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-41781342-c1aa-4620-a684-6fbd2e87b6ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:02.037598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-41781342-c1aa-4620-a684-6fbd2e87b6ce tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.196331 Dec 15 16:46:02.038172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1364/2517] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:01 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:02.051192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fc050b4e-518d-4e83-bd3d-81d9e9cb9ea7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:46:02.052124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fc050b4e-518d-4e83-bd3d-81d9e9cb9ea7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:02.059311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fc050b4e-518d-4e83-bd3d-81d9e9cb9ea7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:02.059765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fc050b4e-518d-4e83-bd3d-81d9e9cb9ea7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:02.060591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fc050b4e-518d-4e83-bd3d-81d9e9cb9ea7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:02.061035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fc050b4e-518d-4e83-bd3d-81d9e9cb9ea7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:02.121960 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fc050b4e-518d-4e83-bd3d-81d9e9cb9ea7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 38197 microversion: 2.20 time: 0.074202 Dec 15 16:46:02.122502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1154/2518] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:46:02 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 38197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:46:02.984795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7f1bbe38-1284-4be5-a900-36d51bfc9fca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:02.985741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7f1bbe38-1284-4be5-a900-36d51bfc9fca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:02.996382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f1bbe38-1284-4be5-a900-36d51bfc9fca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:02.997180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f1bbe38-1284-4be5-a900-36d51bfc9fca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:02.998506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f1bbe38-1284-4be5-a900-36d51bfc9fca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:02.999177 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7f1bbe38-1284-4be5-a900-36d51bfc9fca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:03.056127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3687cb6c-9f52-4faf-9583-99d4e6ae908a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:03.057168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3687cb6c-9f52-4faf-9583-99d4e6ae908a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:03.064541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3687cb6c-9f52-4faf-9583-99d4e6ae908a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:03.065076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3687cb6c-9f52-4faf-9583-99d4e6ae908a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:03.065876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3687cb6c-9f52-4faf-9583-99d4e6ae908a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:03.066855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3687cb6c-9f52-4faf-9583-99d4e6ae908a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:03.068889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7f1bbe38-1284-4be5-a900-36d51bfc9fca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:03.077175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7f1bbe38-1284-4be5-a900-36d51bfc9fca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099144 Dec 15 16:46:03.077722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1365/2519] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:03.134299 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e5c58f49-6ad6-48cd-bb36-3f02709ad25c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:46:03.135249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e5c58f49-6ad6-48cd-bb36-3f02709ad25c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:03.141621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5c58f49-6ad6-48cd-bb36-3f02709ad25c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:03.142075 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5c58f49-6ad6-48cd-bb36-3f02709ad25c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:03.142881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5c58f49-6ad6-48cd-bb36-3f02709ad25c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:03.143322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e5c58f49-6ad6-48cd-bb36-3f02709ad25c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:03.200077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3687cb6c-9f52-4faf-9583-99d4e6ae908a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:03.205863 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e5c58f49-6ad6-48cd-bb36-3f02709ad25c tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 38197 microversion: 2.20 time: 0.075137 Dec 15 16:46:03.206592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1366/2520] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:46:03 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 38197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:46:03.209270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3687cb6c-9f52-4faf-9583-99d4e6ae908a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.157253 Dec 15 16:46:03.209832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1155/2521] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:03 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:04.099470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8b4c0c5a-e905-498f-882f-6622f0e756ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:04.100892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8b4c0c5a-e905-498f-882f-6622f0e756ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:04.110943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b4c0c5a-e905-498f-882f-6622f0e756ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:04.111421 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b4c0c5a-e905-498f-882f-6622f0e756ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:04.112197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b4c0c5a-e905-498f-882f-6622f0e756ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:04.112670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8b4c0c5a-e905-498f-882f-6622f0e756ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:04.181708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8b4c0c5a-e905-498f-882f-6622f0e756ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:04.189798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8b4c0c5a-e905-498f-882f-6622f0e756ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097600 Dec 15 16:46:04.190359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1367/2522] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:04 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:04.218067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-33d34358-238a-4a6e-ae25-d48231676b19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:46:04.219062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-33d34358-238a-4a6e-ae25-d48231676b19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:04.226914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bbc9e268-9256-4274-b16e-470cd1fe4e1a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:04.227118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33d34358-238a-4a6e-ae25-d48231676b19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:04.227620 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33d34358-238a-4a6e-ae25-d48231676b19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:04.227761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bbc9e268-9256-4274-b16e-470cd1fe4e1a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:04.228802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33d34358-238a-4a6e-ae25-d48231676b19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:04.229450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33d34358-238a-4a6e-ae25-d48231676b19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:04.235807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bbc9e268-9256-4274-b16e-470cd1fe4e1a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:04.236254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bbc9e268-9256-4274-b16e-470cd1fe4e1a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:04.237080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bbc9e268-9256-4274-b16e-470cd1fe4e1a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:04.237514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bbc9e268-9256-4274-b16e-470cd1fe4e1a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:04.301216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-33d34358-238a-4a6e-ae25-d48231676b19 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action" status: 200 len: 38338 microversion: 2.20 time: 0.086761 Dec 15 16:46:04.303176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1156/2523] 10.222.0.30 () {62 vars in 1318 bytes} [Wed Dec 15 16:46:04 2021] POST /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/action => generated 38338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:46:04.313180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-96d50e14-3072-447b-9160-4099976fc6c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:04.313751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-96d50e14-3072-447b-9160-4099976fc6c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:04.320867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96d50e14-3072-447b-9160-4099976fc6c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:04.321312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96d50e14-3072-447b-9160-4099976fc6c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:04.322090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96d50e14-3072-447b-9160-4099976fc6c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:04.322516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96d50e14-3072-447b-9160-4099976fc6c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:04.346452 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-96d50e14-3072-447b-9160-4099976fc6c4 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/ips" status: 200 len: 152 microversion: 2.20 time: 0.037630 Dec 15 16:46:04.347207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1157/2524] 10.222.0.30 () {60 vars in 1288 bytes} [Wed Dec 15 16:46:04 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:46:04.374950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bbc9e268-9256-4274-b16e-470cd1fe4e1a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:04.383194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bbc9e268-9256-4274-b16e-470cd1fe4e1a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.160629 Dec 15 16:46:04.383765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1368/2525] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:04 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:05.210799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b410c795-1de0-4e4a-92be-6a7e743d824b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:05.211810 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b410c795-1de0-4e4a-92be-6a7e743d824b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:05.221222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b410c795-1de0-4e4a-92be-6a7e743d824b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:05.221837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b410c795-1de0-4e4a-92be-6a7e743d824b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:05.222438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b410c795-1de0-4e4a-92be-6a7e743d824b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:05.222868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b410c795-1de0-4e4a-92be-6a7e743d824b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:05.284861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b410c795-1de0-4e4a-92be-6a7e743d824b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:05.293763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b410c795-1de0-4e4a-92be-6a7e743d824b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089184 Dec 15 16:46:05.294350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1158/2526] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:05.404174 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ec1158ac-69d5-4d4d-a63e-2541bb017f8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:05.405262 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ec1158ac-69d5-4d4d-a63e-2541bb017f8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:05.412464 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ec1158ac-69d5-4d4d-a63e-2541bb017f8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:05.412934 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ec1158ac-69d5-4d4d-a63e-2541bb017f8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:05.413755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ec1158ac-69d5-4d4d-a63e-2541bb017f8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:05.414211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ec1158ac-69d5-4d4d-a63e-2541bb017f8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:05.554620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ec1158ac-69d5-4d4d-a63e-2541bb017f8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:05.563029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ec1158ac-69d5-4d4d-a63e-2541bb017f8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.165099 Dec 15 16:46:05.563686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1369/2527] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:05 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:06.316000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-81440afe-a37c-4ae2-984f-3e210e5f9f30 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:06.317064 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-81440afe-a37c-4ae2-984f-3e210e5f9f30 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:06.327812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81440afe-a37c-4ae2-984f-3e210e5f9f30 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:06.328278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81440afe-a37c-4ae2-984f-3e210e5f9f30 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:06.329101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81440afe-a37c-4ae2-984f-3e210e5f9f30 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:06.329544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-81440afe-a37c-4ae2-984f-3e210e5f9f30 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:06.389053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-81440afe-a37c-4ae2-984f-3e210e5f9f30 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:06.397718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-81440afe-a37c-4ae2-984f-3e210e5f9f30 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088569 Dec 15 16:46:06.398289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1159/2528] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:06.584294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-59c266a3-ed96-46f8-9068-947330758961 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:06.585338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-59c266a3-ed96-46f8-9068-947330758961 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:06.596906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59c266a3-ed96-46f8-9068-947330758961 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:06.597573 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59c266a3-ed96-46f8-9068-947330758961 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:06.598786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59c266a3-ed96-46f8-9068-947330758961 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:06.599436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59c266a3-ed96-46f8-9068-947330758961 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:06.747356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-59c266a3-ed96-46f8-9068-947330758961 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:06.755496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-59c266a3-ed96-46f8-9068-947330758961 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.177348 Dec 15 16:46:06.756103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1370/2529] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:06 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:07.419223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-688985ad-1028-4783-a44c-50a11467b65c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:07.420233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-688985ad-1028-4783-a44c-50a11467b65c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:07.431635 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-688985ad-1028-4783-a44c-50a11467b65c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:07.432492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-688985ad-1028-4783-a44c-50a11467b65c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:07.433954 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-688985ad-1028-4783-a44c-50a11467b65c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:07.434677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-688985ad-1028-4783-a44c-50a11467b65c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:07.496067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-688985ad-1028-4783-a44c-50a11467b65c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:07.504399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-688985ad-1028-4783-a44c-50a11467b65c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091605 Dec 15 16:46:07.505005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1160/2530] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:07.777238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ece37329-cfa0-442b-8a5c-2af2de37733c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:07.778131 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ece37329-cfa0-442b-8a5c-2af2de37733c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:07.788993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ece37329-cfa0-442b-8a5c-2af2de37733c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:07.789738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ece37329-cfa0-442b-8a5c-2af2de37733c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:07.791007 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ece37329-cfa0-442b-8a5c-2af2de37733c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:07.791714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ece37329-cfa0-442b-8a5c-2af2de37733c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:07.929842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ece37329-cfa0-442b-8a5c-2af2de37733c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:07.942146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ece37329-cfa0-442b-8a5c-2af2de37733c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170952 Dec 15 16:46:07.942778 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1371/2531] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:07 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:08.526247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3f62d68b-10ff-44a2-a5c0-ee2fe893a473 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:08.527129 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3f62d68b-10ff-44a2-a5c0-ee2fe893a473 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:08.538030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3f62d68b-10ff-44a2-a5c0-ee2fe893a473 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:08.538775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3f62d68b-10ff-44a2-a5c0-ee2fe893a473 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:08.540056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3f62d68b-10ff-44a2-a5c0-ee2fe893a473 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:08.540868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3f62d68b-10ff-44a2-a5c0-ee2fe893a473 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:08.616358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3f62d68b-10ff-44a2-a5c0-ee2fe893a473 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:08.627517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3f62d68b-10ff-44a2-a5c0-ee2fe893a473 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.107476 Dec 15 16:46:08.628284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1161/2532] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:08.966856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-85cfa2ac-c444-4875-ad62-cc0c81854354 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:08.967866 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-85cfa2ac-c444-4875-ad62-cc0c81854354 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:08.975891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85cfa2ac-c444-4875-ad62-cc0c81854354 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:08.976349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85cfa2ac-c444-4875-ad62-cc0c81854354 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:08.977155 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85cfa2ac-c444-4875-ad62-cc0c81854354 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:08.977582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-85cfa2ac-c444-4875-ad62-cc0c81854354 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:09.114687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-85cfa2ac-c444-4875-ad62-cc0c81854354 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:09.122962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-85cfa2ac-c444-4875-ad62-cc0c81854354 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.162286 Dec 15 16:46:09.123488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1372/2533] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:08 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:09.652979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1c4a7805-48e7-4189-af5d-8aa96cbaf291 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:09.653938 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1c4a7805-48e7-4189-af5d-8aa96cbaf291 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:09.662030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c4a7805-48e7-4189-af5d-8aa96cbaf291 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:09.662474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c4a7805-48e7-4189-af5d-8aa96cbaf291 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:09.663250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c4a7805-48e7-4189-af5d-8aa96cbaf291 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:09.663675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c4a7805-48e7-4189-af5d-8aa96cbaf291 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:09.732852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1c4a7805-48e7-4189-af5d-8aa96cbaf291 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:09.741262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1c4a7805-48e7-4189-af5d-8aa96cbaf291 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094488 Dec 15 16:46:09.741822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1162/2534] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:10.143441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-633fbc61-3f3e-4d58-8c97-78de2937e546 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:10.144046 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-633fbc61-3f3e-4d58-8c97-78de2937e546 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:10.150892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-633fbc61-3f3e-4d58-8c97-78de2937e546 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:10.151338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-633fbc61-3f3e-4d58-8c97-78de2937e546 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:10.152134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-633fbc61-3f3e-4d58-8c97-78de2937e546 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:10.152601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-633fbc61-3f3e-4d58-8c97-78de2937e546 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:10.288385 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-633fbc61-3f3e-4d58-8c97-78de2937e546 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:10.300379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-633fbc61-3f3e-4d58-8c97-78de2937e546 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161571 Dec 15 16:46:10.301291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1373/2535] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:10 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:10.761049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3549d373-a4d8-45b9-a532-91eeb0809964 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:10.761862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3549d373-a4d8-45b9-a532-91eeb0809964 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:10.770157 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3549d373-a4d8-45b9-a532-91eeb0809964 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:10.770606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3549d373-a4d8-45b9-a532-91eeb0809964 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:10.771389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3549d373-a4d8-45b9-a532-91eeb0809964 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:10.771820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3549d373-a4d8-45b9-a532-91eeb0809964 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:10.844201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3549d373-a4d8-45b9-a532-91eeb0809964 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:10.855422 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3549d373-a4d8-45b9-a532-91eeb0809964 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099452 Dec 15 16:46:10.855993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1163/2536] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:11.326237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-808fc455-40f0-4b98-a87a-3d74afe01987 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:11.327239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-808fc455-40f0-4b98-a87a-3d74afe01987 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:11.338035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-808fc455-40f0-4b98-a87a-3d74afe01987 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:11.338785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-808fc455-40f0-4b98-a87a-3d74afe01987 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:11.340076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-808fc455-40f0-4b98-a87a-3d74afe01987 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:11.340870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-808fc455-40f0-4b98-a87a-3d74afe01987 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:11.480488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-808fc455-40f0-4b98-a87a-3d74afe01987 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:11.489001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-808fc455-40f0-4b98-a87a-3d74afe01987 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169261 Dec 15 16:46:11.489569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1374/2537] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:11 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:11.876929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bef3fd2b-bb83-449d-bbaa-52f803f31870 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:11.877593 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bef3fd2b-bb83-449d-bbaa-52f803f31870 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:11.884980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bef3fd2b-bb83-449d-bbaa-52f803f31870 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:11.885501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bef3fd2b-bb83-449d-bbaa-52f803f31870 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:11.886357 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bef3fd2b-bb83-449d-bbaa-52f803f31870 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:11.886835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bef3fd2b-bb83-449d-bbaa-52f803f31870 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:11.950719 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bef3fd2b-bb83-449d-bbaa-52f803f31870 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:11.964033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bef3fd2b-bb83-449d-bbaa-52f803f31870 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092885 Dec 15 16:46:11.964934 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1164/2538] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:12.510541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7493e17a-ed17-4d80-a596-18f9b3b28d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:12.511408 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7493e17a-ed17-4d80-a596-18f9b3b28d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:12.520400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7493e17a-ed17-4d80-a596-18f9b3b28d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:12.520880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7493e17a-ed17-4d80-a596-18f9b3b28d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:12.521663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7493e17a-ed17-4d80-a596-18f9b3b28d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:12.522093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7493e17a-ed17-4d80-a596-18f9b3b28d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:12.672455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7493e17a-ed17-4d80-a596-18f9b3b28d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:12.681291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7493e17a-ed17-4d80-a596-18f9b3b28d5f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.177088 Dec 15 16:46:12.682088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1375/2539] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:12 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:12.986235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e68a9b99-d7cc-4596-9adc-4693c313ccd9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:12.986898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e68a9b99-d7cc-4596-9adc-4693c313ccd9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:12.993909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e68a9b99-d7cc-4596-9adc-4693c313ccd9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:12.994389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e68a9b99-d7cc-4596-9adc-4693c313ccd9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:12.995218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e68a9b99-d7cc-4596-9adc-4693c313ccd9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:12.995680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e68a9b99-d7cc-4596-9adc-4693c313ccd9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:13.058104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e68a9b99-d7cc-4596-9adc-4693c313ccd9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:13.070193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e68a9b99-d7cc-4596-9adc-4693c313ccd9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088782 Dec 15 16:46:13.071014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1165/2540] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:13.702877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5a70461f-9b09-42a3-8bbb-d74d757e0377 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:13.703845 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5a70461f-9b09-42a3-8bbb-d74d757e0377 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:13.711042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a70461f-9b09-42a3-8bbb-d74d757e0377 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:13.711496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a70461f-9b09-42a3-8bbb-d74d757e0377 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:13.712279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a70461f-9b09-42a3-8bbb-d74d757e0377 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:13.712706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5a70461f-9b09-42a3-8bbb-d74d757e0377 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:13.848513 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5a70461f-9b09-42a3-8bbb-d74d757e0377 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:13.860787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5a70461f-9b09-42a3-8bbb-d74d757e0377 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163941 Dec 15 16:46:13.861387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1376/2541] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:13 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:14.087360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-afc20fc2-6327-4d05-88e4-2f2b08d6060e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:14.087930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-afc20fc2-6327-4d05-88e4-2f2b08d6060e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:14.095134 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afc20fc2-6327-4d05-88e4-2f2b08d6060e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:14.095613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afc20fc2-6327-4d05-88e4-2f2b08d6060e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:14.096671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afc20fc2-6327-4d05-88e4-2f2b08d6060e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:14.097109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-afc20fc2-6327-4d05-88e4-2f2b08d6060e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:14.172606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-afc20fc2-6327-4d05-88e4-2f2b08d6060e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:14.184585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-afc20fc2-6327-4d05-88e4-2f2b08d6060e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.100711 Dec 15 16:46:14.185374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1166/2542] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:14 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:14.885166 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e9ee023c-2ea6-4e9c-a511-5328ba97ca8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:14.886120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e9ee023c-2ea6-4e9c-a511-5328ba97ca8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:14.899700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9ee023c-2ea6-4e9c-a511-5328ba97ca8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:14.901092 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9ee023c-2ea6-4e9c-a511-5328ba97ca8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:14.903088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9ee023c-2ea6-4e9c-a511-5328ba97ca8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:14.904205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9ee023c-2ea6-4e9c-a511-5328ba97ca8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:15.055892 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e9ee023c-2ea6-4e9c-a511-5328ba97ca8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:15.070244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e9ee023c-2ea6-4e9c-a511-5328ba97ca8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.191228 Dec 15 16:46:15.070828 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1377/2543] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:14 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:15.207930 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f612b625-9bac-433e-a69c-86e16d5ad40e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:15.208855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f612b625-9bac-433e-a69c-86e16d5ad40e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:15.220009 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f612b625-9bac-433e-a69c-86e16d5ad40e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:15.220951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f612b625-9bac-433e-a69c-86e16d5ad40e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:15.222250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f612b625-9bac-433e-a69c-86e16d5ad40e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:15.223014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f612b625-9bac-433e-a69c-86e16d5ad40e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:15.292349 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f612b625-9bac-433e-a69c-86e16d5ad40e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:15.301362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f612b625-9bac-433e-a69c-86e16d5ad40e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.100673 Dec 15 16:46:15.301936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1167/2544] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:16.087163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8ffdfa97-5244-482d-812e-5d08ec0b968c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:16.087752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8ffdfa97-5244-482d-812e-5d08ec0b968c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:16.094337 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ffdfa97-5244-482d-812e-5d08ec0b968c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:16.095205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ffdfa97-5244-482d-812e-5d08ec0b968c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:16.095985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ffdfa97-5244-482d-812e-5d08ec0b968c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:16.096416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8ffdfa97-5244-482d-812e-5d08ec0b968c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:16.309724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8ffdfa97-5244-482d-812e-5d08ec0b968c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:16.318364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8ffdfa97-5244-482d-812e-5d08ec0b968c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.234911 Dec 15 16:46:16.318688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3a723dee-d7ca-41f0-9d0e-f6f0268a52a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:16.319258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1378/2545] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:16 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:16.328526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3a723dee-d7ca-41f0-9d0e-f6f0268a52a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:16.335158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a723dee-d7ca-41f0-9d0e-f6f0268a52a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:16.335681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a723dee-d7ca-41f0-9d0e-f6f0268a52a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:16.336598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a723dee-d7ca-41f0-9d0e-f6f0268a52a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:16.337136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3a723dee-d7ca-41f0-9d0e-f6f0268a52a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:16.411745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3a723dee-d7ca-41f0-9d0e-f6f0268a52a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:16.419758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3a723dee-d7ca-41f0-9d0e-f6f0268a52a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.104961 Dec 15 16:46:16.420322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1168/2546] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:16 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:17.339597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-21f6c729-b132-446a-844f-95247ee75cf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:17.340570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-21f6c729-b132-446a-844f-95247ee75cf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:17.351626 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21f6c729-b132-446a-844f-95247ee75cf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:17.352376 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21f6c729-b132-446a-844f-95247ee75cf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:17.353724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21f6c729-b132-446a-844f-95247ee75cf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:17.354449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-21f6c729-b132-446a-844f-95247ee75cf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:17.440229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cc2b9534-e8e7-4586-b81d-857c6e7d4a75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:17.440736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cc2b9534-e8e7-4586-b81d-857c6e7d4a75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:17.450386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc2b9534-e8e7-4586-b81d-857c6e7d4a75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:17.450828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc2b9534-e8e7-4586-b81d-857c6e7d4a75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:17.451607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc2b9534-e8e7-4586-b81d-857c6e7d4a75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:17.452034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cc2b9534-e8e7-4586-b81d-857c6e7d4a75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:17.505396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-21f6c729-b132-446a-844f-95247ee75cf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:17.513780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-21f6c729-b132-446a-844f-95247ee75cf5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.180354 Dec 15 16:46:17.514356 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1379/2547] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:17 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:17.519549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cc2b9534-e8e7-4586-b81d-857c6e7d4a75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:17.527548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cc2b9534-e8e7-4586-b81d-857c6e7d4a75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091503 Dec 15 16:46:17.528104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1169/2548] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:18.534960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d8818b8d-4dbc-4a82-93b6-add2c85d5f77 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:18.535611 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d8818b8d-4dbc-4a82-93b6-add2c85d5f77 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:18.543822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8818b8d-4dbc-4a82-93b6-add2c85d5f77 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:18.544362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8818b8d-4dbc-4a82-93b6-add2c85d5f77 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:18.545352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8818b8d-4dbc-4a82-93b6-add2c85d5f77 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:18.545517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-da6e93f8-5119-4edd-aae8-4d441366954b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:18.545985 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8818b8d-4dbc-4a82-93b6-add2c85d5f77 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:18.546217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-da6e93f8-5119-4edd-aae8-4d441366954b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:18.554115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da6e93f8-5119-4edd-aae8-4d441366954b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:18.554634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da6e93f8-5119-4edd-aae8-4d441366954b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:18.555562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da6e93f8-5119-4edd-aae8-4d441366954b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:18.556072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da6e93f8-5119-4edd-aae8-4d441366954b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:18.631717 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-da6e93f8-5119-4edd-aae8-4d441366954b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:18.639791 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-da6e93f8-5119-4edd-aae8-4d441366954b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098569 Dec 15 16:46:18.640366 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1170/2549] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:18.705927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d8818b8d-4dbc-4a82-93b6-add2c85d5f77 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:18.718032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d8818b8d-4dbc-4a82-93b6-add2c85d5f77 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.189161 Dec 15 16:46:18.718805 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1380/2550] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:18 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:19.660019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-226a0e4e-ff57-4fb5-bfed-d01f6ea58e3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:19.660852 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-226a0e4e-ff57-4fb5-bfed-d01f6ea58e3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:19.669703 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-226a0e4e-ff57-4fb5-bfed-d01f6ea58e3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:19.670314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-226a0e4e-ff57-4fb5-bfed-d01f6ea58e3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:19.671397 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-226a0e4e-ff57-4fb5-bfed-d01f6ea58e3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:19.672031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-226a0e4e-ff57-4fb5-bfed-d01f6ea58e3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:19.736834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e83f3c61-398c-4032-9c4a-1d863af6a38c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:19.737822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e83f3c61-398c-4032-9c4a-1d863af6a38c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:19.746092 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e83f3c61-398c-4032-9c4a-1d863af6a38c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:19.746092 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e83f3c61-398c-4032-9c4a-1d863af6a38c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:19.746498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e83f3c61-398c-4032-9c4a-1d863af6a38c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:19.746927 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e83f3c61-398c-4032-9c4a-1d863af6a38c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:19.748243 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-226a0e4e-ff57-4fb5-bfed-d01f6ea58e3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:19.759850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-226a0e4e-ff57-4fb5-bfed-d01f6ea58e3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.105025 Dec 15 16:46:19.760548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1171/2551] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:19 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:19.905865 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e83f3c61-398c-4032-9c4a-1d863af6a38c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:19.918000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e83f3c61-398c-4032-9c4a-1d863af6a38c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.184527 Dec 15 16:46:19.918786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1381/2552] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:19 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:46:20.785137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e7576dc8-051f-46f6-8a1e-2b75c936c8ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:20.785790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e7576dc8-051f-46f6-8a1e-2b75c936c8ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:20.792768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7576dc8-051f-46f6-8a1e-2b75c936c8ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:20.793247 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7576dc8-051f-46f6-8a1e-2b75c936c8ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:20.794062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7576dc8-051f-46f6-8a1e-2b75c936c8ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:20.794520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7576dc8-051f-46f6-8a1e-2b75c936c8ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:20.861716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e7576dc8-051f-46f6-8a1e-2b75c936c8ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:20.870395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e7576dc8-051f-46f6-8a1e-2b75c936c8ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091367 Dec 15 16:46:20.870934 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1172/2553] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:20 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:20.936971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-319ad1e9-1d06-4963-b216-474489c45109 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:20.937584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-319ad1e9-1d06-4963-b216-474489c45109 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:20.944415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-319ad1e9-1d06-4963-b216-474489c45109 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:20.944984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-319ad1e9-1d06-4963-b216-474489c45109 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:20.945756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-319ad1e9-1d06-4963-b216-474489c45109 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:20.946184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-319ad1e9-1d06-4963-b216-474489c45109 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:21.095191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-319ad1e9-1d06-4963-b216-474489c45109 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:21.107659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-319ad1e9-1d06-4963-b216-474489c45109 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.174116 Dec 15 16:46:21.108366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1382/2554] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:20 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:21.891562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5a4a5195-3d46-4472-a749-1e094b8c5d58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:21.892332 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5a4a5195-3d46-4472-a749-1e094b8c5d58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:21.899556 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5a4a5195-3d46-4472-a749-1e094b8c5d58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:21.900003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5a4a5195-3d46-4472-a749-1e094b8c5d58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:21.900819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5a4a5195-3d46-4472-a749-1e094b8c5d58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:21.901252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5a4a5195-3d46-4472-a749-1e094b8c5d58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:21.961796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5a4a5195-3d46-4472-a749-1e094b8c5d58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:21.970148 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5a4a5195-3d46-4472-a749-1e094b8c5d58 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.082934 Dec 15 16:46:21.970706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1173/2555] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:22.129683 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-94350aa7-eba4-414b-969a-3c173912d9c4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:22.130694 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-94350aa7-eba4-414b-969a-3c173912d9c4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:22.140954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94350aa7-eba4-414b-969a-3c173912d9c4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:22.141772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94350aa7-eba4-414b-969a-3c173912d9c4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:22.142961 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94350aa7-eba4-414b-969a-3c173912d9c4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:22.143675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-94350aa7-eba4-414b-969a-3c173912d9c4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:22.544020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-94350aa7-eba4-414b-969a-3c173912d9c4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:22.557107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-94350aa7-eba4-414b-969a-3c173912d9c4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.433362 Dec 15 16:46:22.558070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1383/2556] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:22 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:22.992324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-313222ab-edf3-4244-83e2-793ed7d9c1e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:22.993446 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-313222ab-edf3-4244-83e2-793ed7d9c1e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:23.006091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-313222ab-edf3-4244-83e2-793ed7d9c1e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:23.006542 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-313222ab-edf3-4244-83e2-793ed7d9c1e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:23.007341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-313222ab-edf3-4244-83e2-793ed7d9c1e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:23.007775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-313222ab-edf3-4244-83e2-793ed7d9c1e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:23.078072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-313222ab-edf3-4244-83e2-793ed7d9c1e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:23.093091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-313222ab-edf3-4244-83e2-793ed7d9c1e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.107408 Dec 15 16:46:23.093917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1174/2557] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:23.581959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0a9d8df7-f0af-4370-9d01-cb4c29be4d61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:23.582898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0a9d8df7-f0af-4370-9d01-cb4c29be4d61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:23.593926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a9d8df7-f0af-4370-9d01-cb4c29be4d61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:23.594670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a9d8df7-f0af-4370-9d01-cb4c29be4d61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:23.596391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a9d8df7-f0af-4370-9d01-cb4c29be4d61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:23.597164 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0a9d8df7-f0af-4370-9d01-cb4c29be4d61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:23.738216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0a9d8df7-f0af-4370-9d01-cb4c29be4d61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:23.746336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0a9d8df7-f0af-4370-9d01-cb4c29be4d61 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170634 Dec 15 16:46:23.746914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1384/2558] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:23 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:24.116019 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-54f7ebb1-3df7-4a17-9a49-18807886289d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:24.117027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-54f7ebb1-3df7-4a17-9a49-18807886289d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:24.131275 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-54f7ebb1-3df7-4a17-9a49-18807886289d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:24.131726 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-54f7ebb1-3df7-4a17-9a49-18807886289d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:24.132567 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-54f7ebb1-3df7-4a17-9a49-18807886289d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:24.133001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-54f7ebb1-3df7-4a17-9a49-18807886289d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:24.202879 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-54f7ebb1-3df7-4a17-9a49-18807886289d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:24.211479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-54f7ebb1-3df7-4a17-9a49-18807886289d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.102609 Dec 15 16:46:24.212050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1175/2559] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:24 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:24.767383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0d3f1577-7e4b-46ff-9d70-f280110ab1ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:24.768277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0d3f1577-7e4b-46ff-9d70-f280110ab1ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:24.776041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d3f1577-7e4b-46ff-9d70-f280110ab1ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:24.776480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d3f1577-7e4b-46ff-9d70-f280110ab1ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:24.777286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d3f1577-7e4b-46ff-9d70-f280110ab1ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:24.777710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d3f1577-7e4b-46ff-9d70-f280110ab1ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:24.918507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0d3f1577-7e4b-46ff-9d70-f280110ab1ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:24.930594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0d3f1577-7e4b-46ff-9d70-f280110ab1ed tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169237 Dec 15 16:46:24.931379 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1385/2560] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:24 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:25.229497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0264945c-3ee3-49c7-8d8d-477eb0cc2094 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:25.230228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0264945c-3ee3-49c7-8d8d-477eb0cc2094 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:25.238746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0264945c-3ee3-49c7-8d8d-477eb0cc2094 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:25.239353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0264945c-3ee3-49c7-8d8d-477eb0cc2094 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:25.240384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0264945c-3ee3-49c7-8d8d-477eb0cc2094 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:25.240842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0264945c-3ee3-49c7-8d8d-477eb0cc2094 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:25.307352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0264945c-3ee3-49c7-8d8d-477eb0cc2094 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:25.315306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0264945c-3ee3-49c7-8d8d-477eb0cc2094 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089900 Dec 15 16:46:25.315890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1176/2561] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:25 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:25.952234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5e55de67-4c4c-40c6-8fac-a6268cd78652 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:25.953251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5e55de67-4c4c-40c6-8fac-a6268cd78652 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:25.961826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e55de67-4c4c-40c6-8fac-a6268cd78652 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:25.962271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e55de67-4c4c-40c6-8fac-a6268cd78652 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:25.963042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e55de67-4c4c-40c6-8fac-a6268cd78652 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:25.963471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5e55de67-4c4c-40c6-8fac-a6268cd78652 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:26.105373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5e55de67-4c4c-40c6-8fac-a6268cd78652 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:26.114071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5e55de67-4c4c-40c6-8fac-a6268cd78652 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168006 Dec 15 16:46:26.114904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1386/2562] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:25 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:26.336489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ffcda379-bc6c-4577-a992-29f76f418641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:26.337532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ffcda379-bc6c-4577-a992-29f76f418641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:26.348391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ffcda379-bc6c-4577-a992-29f76f418641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:26.349136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ffcda379-bc6c-4577-a992-29f76f418641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:26.350116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ffcda379-bc6c-4577-a992-29f76f418641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:26.350548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ffcda379-bc6c-4577-a992-29f76f418641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:26.411018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ffcda379-bc6c-4577-a992-29f76f418641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:26.422447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ffcda379-bc6c-4577-a992-29f76f418641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091727 Dec 15 16:46:26.423175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1177/2563] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:27.134757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-61edd41a-a1f7-4c65-a244-1baf22c0d14d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:27.135368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-61edd41a-a1f7-4c65-a244-1baf22c0d14d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:27.142107 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61edd41a-a1f7-4c65-a244-1baf22c0d14d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:27.142561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61edd41a-a1f7-4c65-a244-1baf22c0d14d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:27.143372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61edd41a-a1f7-4c65-a244-1baf22c0d14d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:27.143783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61edd41a-a1f7-4c65-a244-1baf22c0d14d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:27.292754 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-61edd41a-a1f7-4c65-a244-1baf22c0d14d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:27.301138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-61edd41a-a1f7-4c65-a244-1baf22c0d14d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170363 Dec 15 16:46:27.301741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1387/2564] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:27 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:27.446782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a12dd72d-0aa6-4495-bc4d-1a9cbf2c98b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:27.447344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a12dd72d-0aa6-4495-bc4d-1a9cbf2c98b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:27.454221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a12dd72d-0aa6-4495-bc4d-1a9cbf2c98b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:27.454664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a12dd72d-0aa6-4495-bc4d-1a9cbf2c98b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:27.455437 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a12dd72d-0aa6-4495-bc4d-1a9cbf2c98b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:27.455859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a12dd72d-0aa6-4495-bc4d-1a9cbf2c98b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:27.515713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a12dd72d-0aa6-4495-bc4d-1a9cbf2c98b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:27.524048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a12dd72d-0aa6-4495-bc4d-1a9cbf2c98b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.081486 Dec 15 16:46:27.524651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1178/2565] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:27 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:28.322775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-31440d55-e48d-41e6-8cd7-8afba5cc4a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:28.324041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-31440d55-e48d-41e6-8cd7-8afba5cc4a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:28.334386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31440d55-e48d-41e6-8cd7-8afba5cc4a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:28.334837 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31440d55-e48d-41e6-8cd7-8afba5cc4a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:28.335615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31440d55-e48d-41e6-8cd7-8afba5cc4a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:28.336049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-31440d55-e48d-41e6-8cd7-8afba5cc4a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:28.481377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-31440d55-e48d-41e6-8cd7-8afba5cc4a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:28.489413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-31440d55-e48d-41e6-8cd7-8afba5cc4a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172821 Dec 15 16:46:28.489988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1388/2566] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:28 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:28.543710 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6d76173d-d54f-4e98-a13c-699e253ec833 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:28.544297 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6d76173d-d54f-4e98-a13c-699e253ec833 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:28.553664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6d76173d-d54f-4e98-a13c-699e253ec833 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:28.554114 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6d76173d-d54f-4e98-a13c-699e253ec833 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:28.554885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6d76173d-d54f-4e98-a13c-699e253ec833 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:28.555315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6d76173d-d54f-4e98-a13c-699e253ec833 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:28.625291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6d76173d-d54f-4e98-a13c-699e253ec833 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:28.635214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6d76173d-d54f-4e98-a13c-699e253ec833 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097295 Dec 15 16:46:28.635784 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1179/2567] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:29.511681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f5f94506-32f3-4037-a145-eacb05f79a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:29.512590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f5f94506-32f3-4037-a145-eacb05f79a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:29.523335 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5f94506-32f3-4037-a145-eacb05f79a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:29.524088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5f94506-32f3-4037-a145-eacb05f79a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:29.525434 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5f94506-32f3-4037-a145-eacb05f79a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:29.526157 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f5f94506-32f3-4037-a145-eacb05f79a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:29.653161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d915493e-b6fa-4824-aede-0575902a0ac6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:29.653776 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d915493e-b6fa-4824-aede-0575902a0ac6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:29.660803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d915493e-b6fa-4824-aede-0575902a0ac6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:29.662863 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d915493e-b6fa-4824-aede-0575902a0ac6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:29.663758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d915493e-b6fa-4824-aede-0575902a0ac6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:29.663904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f5f94506-32f3-4037-a145-eacb05f79a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:29.664324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d915493e-b6fa-4824-aede-0575902a0ac6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:29.672149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f5f94506-32f3-4037-a145-eacb05f79a34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167146 Dec 15 16:46:29.672728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1389/2568] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:29 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:29.727159 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d915493e-b6fa-4824-aede-0575902a0ac6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:29.734910 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d915493e-b6fa-4824-aede-0575902a0ac6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085455 Dec 15 16:46:29.735485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1180/2569] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:30.693373 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b039d445-a02b-4ace-95d5-052f6d263cb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:30.694339 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b039d445-a02b-4ace-95d5-052f6d263cb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:30.704950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b039d445-a02b-4ace-95d5-052f6d263cb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:30.705745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b039d445-a02b-4ace-95d5-052f6d263cb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:30.707044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b039d445-a02b-4ace-95d5-052f6d263cb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:30.707745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b039d445-a02b-4ace-95d5-052f6d263cb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:30.752696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-83024957-61c8-41fa-9764-e18c487e9641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:30.753311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-83024957-61c8-41fa-9764-e18c487e9641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:30.760039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83024957-61c8-41fa-9764-e18c487e9641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:30.760522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83024957-61c8-41fa-9764-e18c487e9641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:30.761315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83024957-61c8-41fa-9764-e18c487e9641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:30.761750 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83024957-61c8-41fa-9764-e18c487e9641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:30.827790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-83024957-61c8-41fa-9764-e18c487e9641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:30.836050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-83024957-61c8-41fa-9764-e18c487e9641 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087060 Dec 15 16:46:30.836688 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1181/2570] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:30.862783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b039d445-a02b-4ace-95d5-052f6d263cb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:30.871518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b039d445-a02b-4ace-95d5-052f6d263cb6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.184485 Dec 15 16:46:30.872011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1390/2571] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:30 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:31.859549 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bdd42716-bfac-45bb-9b0b-09b31621e097 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:31.860584 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-bdd42716-bfac-45bb-9b0b-09b31621e097 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:31.871211 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bdd42716-bfac-45bb-9b0b-09b31621e097 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:31.871951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bdd42716-bfac-45bb-9b0b-09b31621e097 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:31.873293 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bdd42716-bfac-45bb-9b0b-09b31621e097 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:31.873989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-bdd42716-bfac-45bb-9b0b-09b31621e097 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:31.890963 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e7dcdce9-3659-4505-b3b5-442db6e4868f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:31.891546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e7dcdce9-3659-4505-b3b5-442db6e4868f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:31.898427 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7dcdce9-3659-4505-b3b5-442db6e4868f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:31.898875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7dcdce9-3659-4505-b3b5-442db6e4868f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:31.899647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7dcdce9-3659-4505-b3b5-442db6e4868f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:31.900083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e7dcdce9-3659-4505-b3b5-442db6e4868f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:31.938580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-bdd42716-bfac-45bb-9b0b-09b31621e097 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:31.946770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bdd42716-bfac-45bb-9b0b-09b31621e097 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094479 Dec 15 16:46:31.947318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1182/2572] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:32.046262 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e7dcdce9-3659-4505-b3b5-442db6e4868f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:32.055457 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e7dcdce9-3659-4505-b3b5-442db6e4868f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168167 Dec 15 16:46:32.056035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1391/2573] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:31 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:32.967235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ccab909f-ded3-4928-a03f-0afb9d39c62d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:32.968178 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ccab909f-ded3-4928-a03f-0afb9d39c62d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:32.979217 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccab909f-ded3-4928-a03f-0afb9d39c62d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:32.979965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccab909f-ded3-4928-a03f-0afb9d39c62d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:32.981287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccab909f-ded3-4928-a03f-0afb9d39c62d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:32.982004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccab909f-ded3-4928-a03f-0afb9d39c62d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:33.046517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ccab909f-ded3-4928-a03f-0afb9d39c62d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:33.054568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ccab909f-ded3-4928-a03f-0afb9d39c62d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093515 Dec 15 16:46:33.055143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1183/2574] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:33.073600 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e70d3c60-f9a5-44d0-bc85-96ecdbae421d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:33.074227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e70d3c60-f9a5-44d0-bc85-96ecdbae421d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:33.080720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e70d3c60-f9a5-44d0-bc85-96ecdbae421d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:33.081179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e70d3c60-f9a5-44d0-bc85-96ecdbae421d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:33.081954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e70d3c60-f9a5-44d0-bc85-96ecdbae421d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:33.082583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e70d3c60-f9a5-44d0-bc85-96ecdbae421d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:33.219702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e70d3c60-f9a5-44d0-bc85-96ecdbae421d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:33.228406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e70d3c60-f9a5-44d0-bc85-96ecdbae421d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.158451 Dec 15 16:46:33.229019 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1392/2575] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:33 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:34.079972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-17757a13-aa78-4a7f-9e81-5ef9aa95e9f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:34.080985 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-17757a13-aa78-4a7f-9e81-5ef9aa95e9f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:34.091968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-17757a13-aa78-4a7f-9e81-5ef9aa95e9f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:34.092780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-17757a13-aa78-4a7f-9e81-5ef9aa95e9f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:34.094123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-17757a13-aa78-4a7f-9e81-5ef9aa95e9f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:34.094840 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-17757a13-aa78-4a7f-9e81-5ef9aa95e9f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:34.159938 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-17757a13-aa78-4a7f-9e81-5ef9aa95e9f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:34.168708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-17757a13-aa78-4a7f-9e81-5ef9aa95e9f4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094861 Dec 15 16:46:34.169263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1184/2576] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:34.256223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8194e545-8d49-4f59-bc87-2f501af51784 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:34.257290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8194e545-8d49-4f59-bc87-2f501af51784 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:34.267842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8194e545-8d49-4f59-bc87-2f501af51784 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:34.268637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8194e545-8d49-4f59-bc87-2f501af51784 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:34.269907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8194e545-8d49-4f59-bc87-2f501af51784 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:34.270711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8194e545-8d49-4f59-bc87-2f501af51784 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:34.464180 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8194e545-8d49-4f59-bc87-2f501af51784 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:34.472532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8194e545-8d49-4f59-bc87-2f501af51784 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.222448 Dec 15 16:46:34.473369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1393/2577] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:34 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:35.193582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a65f6263-b020-4a65-8459-9edfaf28ebb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:35.194725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a65f6263-b020-4a65-8459-9edfaf28ebb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:35.205580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a65f6263-b020-4a65-8459-9edfaf28ebb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:35.206334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a65f6263-b020-4a65-8459-9edfaf28ebb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:35.207647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a65f6263-b020-4a65-8459-9edfaf28ebb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:35.208379 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a65f6263-b020-4a65-8459-9edfaf28ebb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:35.282830 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a65f6263-b020-4a65-8459-9edfaf28ebb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:35.292886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a65f6263-b020-4a65-8459-9edfaf28ebb0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.105502 Dec 15 16:46:35.293458 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1185/2578] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:35.493631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-658c61b2-6a50-427e-a428-82a500edd907 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:35.494476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-658c61b2-6a50-427e-a428-82a500edd907 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:35.503772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-658c61b2-6a50-427e-a428-82a500edd907 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:35.504396 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-658c61b2-6a50-427e-a428-82a500edd907 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:35.505280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-658c61b2-6a50-427e-a428-82a500edd907 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:35.505716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-658c61b2-6a50-427e-a428-82a500edd907 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:35.643099 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-658c61b2-6a50-427e-a428-82a500edd907 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:35.651838 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-658c61b2-6a50-427e-a428-82a500edd907 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.164166 Dec 15 16:46:35.652498 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1394/2579] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:35 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:36.315130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ff3f1f34-160f-4c08-be0a-443bfdd520a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:36.316191 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ff3f1f34-160f-4c08-be0a-443bfdd520a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:36.324329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f34-160f-4c08-be0a-443bfdd520a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:36.324817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f34-160f-4c08-be0a-443bfdd520a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:36.325595 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f34-160f-4c08-be0a-443bfdd520a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:36.326026 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff3f1f34-160f-4c08-be0a-443bfdd520a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:36.390795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ff3f1f34-160f-4c08-be0a-443bfdd520a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:36.399025 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ff3f1f34-160f-4c08-be0a-443bfdd520a9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090162 Dec 15 16:46:36.399602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1186/2580] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:36.673208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e37df0c2-09d5-4910-be04-f8a4976ed420 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:36.674078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e37df0c2-09d5-4910-be04-f8a4976ed420 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:36.682956 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e37df0c2-09d5-4910-be04-f8a4976ed420 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:36.683403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e37df0c2-09d5-4910-be04-f8a4976ed420 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:36.684188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e37df0c2-09d5-4910-be04-f8a4976ed420 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:36.684662 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e37df0c2-09d5-4910-be04-f8a4976ed420 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:36.820423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e37df0c2-09d5-4910-be04-f8a4976ed420 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:36.828370 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e37df0c2-09d5-4910-be04-f8a4976ed420 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161419 Dec 15 16:46:36.828973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1395/2581] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:36 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:37.420142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d23f9fd8-3d06-4ce0-a4dd-793b6b3ae8bb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:37.421085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d23f9fd8-3d06-4ce0-a4dd-793b6b3ae8bb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:37.431101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d23f9fd8-3d06-4ce0-a4dd-793b6b3ae8bb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:37.431556 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d23f9fd8-3d06-4ce0-a4dd-793b6b3ae8bb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:37.432344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d23f9fd8-3d06-4ce0-a4dd-793b6b3ae8bb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:37.432818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d23f9fd8-3d06-4ce0-a4dd-793b6b3ae8bb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:37.501144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d23f9fd8-3d06-4ce0-a4dd-793b6b3ae8bb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:37.510195 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d23f9fd8-3d06-4ce0-a4dd-793b6b3ae8bb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096348 Dec 15 16:46:37.510772 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1187/2582] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:37.850095 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6aef53b1-ef1e-4e4e-a26c-2b05c5976e5d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:37.850914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6aef53b1-ef1e-4e4e-a26c-2b05c5976e5d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:37.857984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6aef53b1-ef1e-4e4e-a26c-2b05c5976e5d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:37.858438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6aef53b1-ef1e-4e4e-a26c-2b05c5976e5d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:37.859217 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6aef53b1-ef1e-4e4e-a26c-2b05c5976e5d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:37.859660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6aef53b1-ef1e-4e4e-a26c-2b05c5976e5d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:37.998723 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6aef53b1-ef1e-4e4e-a26c-2b05c5976e5d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:38.006888 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6aef53b1-ef1e-4e4e-a26c-2b05c5976e5d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163317 Dec 15 16:46:38.007625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1396/2583] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:37 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:38.531079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-47df52e0-cc76-4c6f-a41c-f8133b34edc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:38.531967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-47df52e0-cc76-4c6f-a41c-f8133b34edc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:38.541256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47df52e0-cc76-4c6f-a41c-f8133b34edc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:38.541702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47df52e0-cc76-4c6f-a41c-f8133b34edc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:38.542477 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47df52e0-cc76-4c6f-a41c-f8133b34edc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:38.542903 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-47df52e0-cc76-4c6f-a41c-f8133b34edc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:38.611793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-47df52e0-cc76-4c6f-a41c-f8133b34edc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:38.620284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-47df52e0-cc76-4c6f-a41c-f8133b34edc5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095494 Dec 15 16:46:38.620889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1188/2584] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:39.026076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4ea8ed3b-07e0-4b07-9e81-ae6b1e517c34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:39.026776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4ea8ed3b-07e0-4b07-9e81-ae6b1e517c34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:39.035167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed3b-07e0-4b07-9e81-ae6b1e517c34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:39.035718 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed3b-07e0-4b07-9e81-ae6b1e517c34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:39.036731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed3b-07e0-4b07-9e81-ae6b1e517c34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:39.037265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4ea8ed3b-07e0-4b07-9e81-ae6b1e517c34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:39.186736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4ea8ed3b-07e0-4b07-9e81-ae6b1e517c34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:39.194705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4ea8ed3b-07e0-4b07-9e81-ae6b1e517c34 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.173523 Dec 15 16:46:39.195403 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1397/2585] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:39 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:39.641772 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9a0e41b3-e79a-4615-abde-fe9382ecfda5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:39.642736 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9a0e41b3-e79a-4615-abde-fe9382ecfda5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:39.651676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a0e41b3-e79a-4615-abde-fe9382ecfda5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:39.652126 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a0e41b3-e79a-4615-abde-fe9382ecfda5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:39.652950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a0e41b3-e79a-4615-abde-fe9382ecfda5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:39.653386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a0e41b3-e79a-4615-abde-fe9382ecfda5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:39.716401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9a0e41b3-e79a-4615-abde-fe9382ecfda5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:39.725179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9a0e41b3-e79a-4615-abde-fe9382ecfda5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089663 Dec 15 16:46:39.725747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1189/2586] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:39 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:40.214536 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-870c02fc-e94d-4d05-8b79-435d065d0dd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:40.215148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-870c02fc-e94d-4d05-8b79-435d065d0dd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:40.222374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-870c02fc-e94d-4d05-8b79-435d065d0dd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:40.222824 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-870c02fc-e94d-4d05-8b79-435d065d0dd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:40.223604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-870c02fc-e94d-4d05-8b79-435d065d0dd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:40.224041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-870c02fc-e94d-4d05-8b79-435d065d0dd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:40.368297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-870c02fc-e94d-4d05-8b79-435d065d0dd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:40.376948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-870c02fc-e94d-4d05-8b79-435d065d0dd5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166914 Dec 15 16:46:40.377424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1398/2587] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:40 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:40.746043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1c63334e-ebe9-4047-bf6e-3a869e99400b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:40.746871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1c63334e-ebe9-4047-bf6e-3a869e99400b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:40.757106 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c63334e-ebe9-4047-bf6e-3a869e99400b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:40.757920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c63334e-ebe9-4047-bf6e-3a869e99400b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:40.758731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c63334e-ebe9-4047-bf6e-3a869e99400b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:40.759175 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1c63334e-ebe9-4047-bf6e-3a869e99400b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:40.819906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1c63334e-ebe9-4047-bf6e-3a869e99400b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:40.828492 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1c63334e-ebe9-4047-bf6e-3a869e99400b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088357 Dec 15 16:46:40.829103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1190/2588] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:41.395436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d399fb49-61dc-437d-965e-371fb9fe35a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:41.396091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d399fb49-61dc-437d-965e-371fb9fe35a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:41.403740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d399fb49-61dc-437d-965e-371fb9fe35a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:41.404312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d399fb49-61dc-437d-965e-371fb9fe35a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:41.405229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d399fb49-61dc-437d-965e-371fb9fe35a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:41.405742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d399fb49-61dc-437d-965e-371fb9fe35a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:41.545320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d399fb49-61dc-437d-965e-371fb9fe35a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:41.557459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d399fb49-61dc-437d-965e-371fb9fe35a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166045 Dec 15 16:46:41.558167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1399/2589] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:41 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:41.850056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0d41f3cd-635f-449f-92f5-586c23e51f81 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:41.851232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0d41f3cd-635f-449f-92f5-586c23e51f81 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:41.861832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d41f3cd-635f-449f-92f5-586c23e51f81 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:41.862571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d41f3cd-635f-449f-92f5-586c23e51f81 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:41.863838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d41f3cd-635f-449f-92f5-586c23e51f81 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:41.864579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0d41f3cd-635f-449f-92f5-586c23e51f81 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:41.926576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0d41f3cd-635f-449f-92f5-586c23e51f81 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:41.934632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0d41f3cd-635f-449f-92f5-586c23e51f81 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091151 Dec 15 16:46:41.935197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1191/2590] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:42.583666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d8683572-7618-47f4-baca-03730416aefa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:42.584668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d8683572-7618-47f4-baca-03730416aefa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:42.593071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8683572-7618-47f4-baca-03730416aefa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:42.593519 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8683572-7618-47f4-baca-03730416aefa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:42.594297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8683572-7618-47f4-baca-03730416aefa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:42.594733 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d8683572-7618-47f4-baca-03730416aefa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:42.749945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d8683572-7618-47f4-baca-03730416aefa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:42.761899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d8683572-7618-47f4-baca-03730416aefa tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.184412 Dec 15 16:46:42.762476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1400/2591] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:42 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:42.961025 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7b5608de-1476-435b-8299-d282b0d21761 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:42.961890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7b5608de-1476-435b-8299-d282b0d21761 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:42.973190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b5608de-1476-435b-8299-d282b0d21761 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:42.973936 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b5608de-1476-435b-8299-d282b0d21761 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:42.975219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b5608de-1476-435b-8299-d282b0d21761 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:42.976950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b5608de-1476-435b-8299-d282b0d21761 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:43.040992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7b5608de-1476-435b-8299-d282b0d21761 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:43.052823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7b5608de-1476-435b-8299-d282b0d21761 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097872 Dec 15 16:46:43.053524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1192/2592] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:43.783044 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2ba18b1c-ba2b-430d-b063-deefc3d30914 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:43.784010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2ba18b1c-ba2b-430d-b063-deefc3d30914 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:43.793758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ba18b1c-ba2b-430d-b063-deefc3d30914 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:43.794198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ba18b1c-ba2b-430d-b063-deefc3d30914 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:43.794995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ba18b1c-ba2b-430d-b063-deefc3d30914 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:43.795399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ba18b1c-ba2b-430d-b063-deefc3d30914 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:43.938709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2ba18b1c-ba2b-430d-b063-deefc3d30914 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:43.951120 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2ba18b1c-ba2b-430d-b063-deefc3d30914 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.173855 Dec 15 16:46:43.952032 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1401/2593] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:43 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:44.082298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f1d944de-bd8a-4eb8-92d9-063efd44a46a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:44.083099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f1d944de-bd8a-4eb8-92d9-063efd44a46a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:44.091821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1d944de-bd8a-4eb8-92d9-063efd44a46a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:44.092272 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1d944de-bd8a-4eb8-92d9-063efd44a46a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:44.093088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1d944de-bd8a-4eb8-92d9-063efd44a46a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:44.093526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f1d944de-bd8a-4eb8-92d9-063efd44a46a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:44.161251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f1d944de-bd8a-4eb8-92d9-063efd44a46a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:44.169571 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f1d944de-bd8a-4eb8-92d9-063efd44a46a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093312 Dec 15 16:46:44.170141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1193/2594] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:44.973419 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-78709ae2-9308-40cc-b4b6-096bb303ca80 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:44.974565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-78709ae2-9308-40cc-b4b6-096bb303ca80 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:44.983999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78709ae2-9308-40cc-b4b6-096bb303ca80 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:44.984608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78709ae2-9308-40cc-b4b6-096bb303ca80 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:44.985392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78709ae2-9308-40cc-b4b6-096bb303ca80 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:44.985818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-78709ae2-9308-40cc-b4b6-096bb303ca80 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:45.137850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-78709ae2-9308-40cc-b4b6-096bb303ca80 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:45.146266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-78709ae2-9308-40cc-b4b6-096bb303ca80 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.179433 Dec 15 16:46:45.146840 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1402/2595] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:44 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:45.189663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2166181b-405e-4cf1-af18-f06127dffb3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:45.190601 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2166181b-405e-4cf1-af18-f06127dffb3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:45.200324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2166181b-405e-4cf1-af18-f06127dffb3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:45.200854 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2166181b-405e-4cf1-af18-f06127dffb3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:45.201641 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2166181b-405e-4cf1-af18-f06127dffb3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:45.202071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2166181b-405e-4cf1-af18-f06127dffb3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:45.274787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2166181b-405e-4cf1-af18-f06127dffb3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:45.282992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2166181b-405e-4cf1-af18-f06127dffb3c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099776 Dec 15 16:46:45.283550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1194/2596] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:46:46.166161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-61567a8c-435a-4fbc-9b66-9da204c568d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:46.166964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-61567a8c-435a-4fbc-9b66-9da204c568d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:46.176018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61567a8c-435a-4fbc-9b66-9da204c568d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:46.176654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61567a8c-435a-4fbc-9b66-9da204c568d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:46.177685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61567a8c-435a-4fbc-9b66-9da204c568d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:46.178257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61567a8c-435a-4fbc-9b66-9da204c568d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:46.299461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5c90896c-e09a-4278-a5dc-9773e1ffb075 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:46.300157 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5c90896c-e09a-4278-a5dc-9773e1ffb075 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:46.306607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c90896c-e09a-4278-a5dc-9773e1ffb075 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:46.307069 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c90896c-e09a-4278-a5dc-9773e1ffb075 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:46.307849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c90896c-e09a-4278-a5dc-9773e1ffb075 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:46.308287 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5c90896c-e09a-4278-a5dc-9773e1ffb075 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:46.326026 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-61567a8c-435a-4fbc-9b66-9da204c568d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:46.334069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-61567a8c-435a-4fbc-9b66-9da204c568d5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172898 Dec 15 16:46:46.334660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1403/2597] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:46 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:46.373402 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5c90896c-e09a-4278-a5dc-9773e1ffb075 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:46.386039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5c90896c-e09a-4278-a5dc-9773e1ffb075 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089988 Dec 15 16:46:46.386765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1195/2598] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:47.355406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b7bc9b20-42d9-4a89-a130-2a422001d64b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:47.356350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b7bc9b20-42d9-4a89-a130-2a422001d64b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:47.363669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7bc9b20-42d9-4a89-a130-2a422001d64b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:47.364125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7bc9b20-42d9-4a89-a130-2a422001d64b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:47.364945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7bc9b20-42d9-4a89-a130-2a422001d64b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:47.365381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b7bc9b20-42d9-4a89-a130-2a422001d64b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:47.405753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-44a11efb-472d-41b2-89ae-e2470b358f8d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:47.406327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-44a11efb-472d-41b2-89ae-e2470b358f8d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:47.414766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44a11efb-472d-41b2-89ae-e2470b358f8d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:47.415384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44a11efb-472d-41b2-89ae-e2470b358f8d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:47.416475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44a11efb-472d-41b2-89ae-e2470b358f8d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:47.417072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-44a11efb-472d-41b2-89ae-e2470b358f8d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:47.489692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-44a11efb-472d-41b2-89ae-e2470b358f8d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:47.498136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-44a11efb-472d-41b2-89ae-e2470b358f8d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098220 Dec 15 16:46:47.498782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1196/2599] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:47 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:47.525781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b7bc9b20-42d9-4a89-a130-2a422001d64b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:47.535147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b7bc9b20-42d9-4a89-a130-2a422001d64b tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.185968 Dec 15 16:46:47.535748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1404/2600] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:47 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:48.519323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9547caf9-a6a5-4846-a263-2777140fef3e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:48.520220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9547caf9-a6a5-4846-a263-2777140fef3e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:48.530284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9547caf9-a6a5-4846-a263-2777140fef3e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:48.530724 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9547caf9-a6a5-4846-a263-2777140fef3e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:48.531496 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9547caf9-a6a5-4846-a263-2777140fef3e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:48.531926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9547caf9-a6a5-4846-a263-2777140fef3e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:48.557547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-778262f4-6cb1-4b1e-a840-39971f92eae8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:48.558171 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-778262f4-6cb1-4b1e-a840-39971f92eae8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:48.565191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-778262f4-6cb1-4b1e-a840-39971f92eae8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:48.565675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-778262f4-6cb1-4b1e-a840-39971f92eae8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:48.566448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-778262f4-6cb1-4b1e-a840-39971f92eae8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:48.566879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-778262f4-6cb1-4b1e-a840-39971f92eae8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:48.593040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9547caf9-a6a5-4846-a263-2777140fef3e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:48.601946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9547caf9-a6a5-4846-a263-2777140fef3e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089083 Dec 15 16:46:48.602614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1197/2601] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:48.702587 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-778262f4-6cb1-4b1e-a840-39971f92eae8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:48.714958 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-778262f4-6cb1-4b1e-a840-39971f92eae8 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.160831 Dec 15 16:46:48.715891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1405/2602] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:48 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:49.623612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a3c9835c-9e9e-4b88-97a2-7a507dc1c2f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:49.624751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a3c9835c-9e9e-4b88-97a2-7a507dc1c2f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:49.635280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a3c9835c-9e9e-4b88-97a2-7a507dc1c2f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:49.636015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a3c9835c-9e9e-4b88-97a2-7a507dc1c2f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:49.637343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a3c9835c-9e9e-4b88-97a2-7a507dc1c2f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:49.638057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a3c9835c-9e9e-4b88-97a2-7a507dc1c2f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:49.708179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a3c9835c-9e9e-4b88-97a2-7a507dc1c2f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:49.716194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a3c9835c-9e9e-4b88-97a2-7a507dc1c2f2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099003 Dec 15 16:46:49.716816 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1198/2603] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:49.738438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-93f7610a-8416-4ac0-90c3-5811144e5cfd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:49.739091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-93f7610a-8416-4ac0-90c3-5811144e5cfd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:49.745780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93f7610a-8416-4ac0-90c3-5811144e5cfd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:49.746236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93f7610a-8416-4ac0-90c3-5811144e5cfd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:49.747022 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93f7610a-8416-4ac0-90c3-5811144e5cfd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:49.747459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-93f7610a-8416-4ac0-90c3-5811144e5cfd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:49.883864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-93f7610a-8416-4ac0-90c3-5811144e5cfd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:49.896236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-93f7610a-8416-4ac0-90c3-5811144e5cfd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161238 Dec 15 16:46:49.897045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1406/2604] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:49 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:50.736937 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4c2b75c2-2c3f-4941-bd8c-8df2bfcce6d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:50.737699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4c2b75c2-2c3f-4941-bd8c-8df2bfcce6d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:50.744634 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c2b75c2-2c3f-4941-bd8c-8df2bfcce6d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:50.745079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c2b75c2-2c3f-4941-bd8c-8df2bfcce6d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:50.745918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c2b75c2-2c3f-4941-bd8c-8df2bfcce6d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:50.746342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4c2b75c2-2c3f-4941-bd8c-8df2bfcce6d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:50.821610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4c2b75c2-2c3f-4941-bd8c-8df2bfcce6d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:50.831556 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4c2b75c2-2c3f-4941-bd8c-8df2bfcce6d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.100216 Dec 15 16:46:50.832140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1199/2605] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:50.916406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9f88eae3-34c2-488b-8b0b-665f5a5599ec tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:50.917407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9f88eae3-34c2-488b-8b0b-665f5a5599ec tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:50.925304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f88eae3-34c2-488b-8b0b-665f5a5599ec tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:50.925745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f88eae3-34c2-488b-8b0b-665f5a5599ec tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:50.926520 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f88eae3-34c2-488b-8b0b-665f5a5599ec tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:50.926940 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9f88eae3-34c2-488b-8b0b-665f5a5599ec tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:51.087098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9f88eae3-34c2-488b-8b0b-665f5a5599ec tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:51.097210 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9f88eae3-34c2-488b-8b0b-665f5a5599ec tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.186165 Dec 15 16:46:51.097806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1407/2606] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:50 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:51.858755 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-59a9ac81-c207-4bf4-bb6b-ee2d7c344c4a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:51.859494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-59a9ac81-c207-4bf4-bb6b-ee2d7c344c4a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:51.867900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-59a9ac81-c207-4bf4-bb6b-ee2d7c344c4a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:51.868478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-59a9ac81-c207-4bf4-bb6b-ee2d7c344c4a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:51.869510 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-59a9ac81-c207-4bf4-bb6b-ee2d7c344c4a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:51.870044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-59a9ac81-c207-4bf4-bb6b-ee2d7c344c4a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:51.938855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-59a9ac81-c207-4bf4-bb6b-ee2d7c344c4a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:51.951358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-59a9ac81-c207-4bf4-bb6b-ee2d7c344c4a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098697 Dec 15 16:46:51.951928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1200/2607] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:52.118136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6d26a2ba-de1d-4ed1-86a5-4d315f5b8f20 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:52.118889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6d26a2ba-de1d-4ed1-86a5-4d315f5b8f20 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:52.127231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d26a2ba-de1d-4ed1-86a5-4d315f5b8f20 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:52.127685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d26a2ba-de1d-4ed1-86a5-4d315f5b8f20 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:52.128538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d26a2ba-de1d-4ed1-86a5-4d315f5b8f20 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:52.128980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d26a2ba-de1d-4ed1-86a5-4d315f5b8f20 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:52.277114 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d26a2ba-de1d-4ed1-86a5-4d315f5b8f20 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:52.286657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6d26a2ba-de1d-4ed1-86a5-4d315f5b8f20 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.174598 Dec 15 16:46:52.287239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1408/2608] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:52 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:52.973076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f98ab7cb-5602-4bcf-99cc-6a4e29b9db71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:52.974001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f98ab7cb-5602-4bcf-99cc-6a4e29b9db71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:52.984782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f98ab7cb-5602-4bcf-99cc-6a4e29b9db71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:52.985574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f98ab7cb-5602-4bcf-99cc-6a4e29b9db71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:52.986914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f98ab7cb-5602-4bcf-99cc-6a4e29b9db71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:52.987674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f98ab7cb-5602-4bcf-99cc-6a4e29b9db71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:53.053742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f98ab7cb-5602-4bcf-99cc-6a4e29b9db71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:53.061884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f98ab7cb-5602-4bcf-99cc-6a4e29b9db71 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095702 Dec 15 16:46:53.062454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1201/2609] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:53.309133 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-233a7db1-70e3-4c99-821b-72dba9126b93 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:53.309742 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-233a7db1-70e3-4c99-821b-72dba9126b93 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:53.319418 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-233a7db1-70e3-4c99-821b-72dba9126b93 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:53.320042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-233a7db1-70e3-4c99-821b-72dba9126b93 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:53.321229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-233a7db1-70e3-4c99-821b-72dba9126b93 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:53.321839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-233a7db1-70e3-4c99-821b-72dba9126b93 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:53.462776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-233a7db1-70e3-4c99-821b-72dba9126b93 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:53.471272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-233a7db1-70e3-4c99-821b-72dba9126b93 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.165884 Dec 15 16:46:53.471842 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1409/2610] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:53 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:54.083383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-90579b84-8390-4ba9-b3a1-6eea20bdf0b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:54.084308 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-90579b84-8390-4ba9-b3a1-6eea20bdf0b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:54.095066 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-90579b84-8390-4ba9-b3a1-6eea20bdf0b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:54.096208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-90579b84-8390-4ba9-b3a1-6eea20bdf0b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:54.097542 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-90579b84-8390-4ba9-b3a1-6eea20bdf0b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:54.098266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-90579b84-8390-4ba9-b3a1-6eea20bdf0b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:54.166005 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-90579b84-8390-4ba9-b3a1-6eea20bdf0b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:54.174144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-90579b84-8390-4ba9-b3a1-6eea20bdf0b7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097029 Dec 15 16:46:54.174709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1202/2611] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:54 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:54.491627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-40ce0953-6161-4435-a700-d79a6914bc12 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:54.492509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-40ce0953-6161-4435-a700-d79a6914bc12 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:54.501014 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40ce0953-6161-4435-a700-d79a6914bc12 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:54.501460 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40ce0953-6161-4435-a700-d79a6914bc12 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:54.502250 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40ce0953-6161-4435-a700-d79a6914bc12 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:54.502680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-40ce0953-6161-4435-a700-d79a6914bc12 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:54.649791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-40ce0953-6161-4435-a700-d79a6914bc12 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:54.662243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-40ce0953-6161-4435-a700-d79a6914bc12 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.176208 Dec 15 16:46:54.662982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1410/2612] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:54 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:55.195709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2b5d4fe5-7253-478d-aa6a-b1df056d9600 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:55.196782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2b5d4fe5-7253-478d-aa6a-b1df056d9600 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:55.207218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b5d4fe5-7253-478d-aa6a-b1df056d9600 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:55.207975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b5d4fe5-7253-478d-aa6a-b1df056d9600 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:55.209329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b5d4fe5-7253-478d-aa6a-b1df056d9600 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:55.210058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2b5d4fe5-7253-478d-aa6a-b1df056d9600 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:55.275546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2b5d4fe5-7253-478d-aa6a-b1df056d9600 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:55.284022 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2b5d4fe5-7253-478d-aa6a-b1df056d9600 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094721 Dec 15 16:46:55.284625 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1203/2613] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:55.686116 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e47f06c2-b56d-417d-bf00-093626ddb933 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:55.687080 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e47f06c2-b56d-417d-bf00-093626ddb933 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:55.697912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e47f06c2-b56d-417d-bf00-093626ddb933 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:55.698660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e47f06c2-b56d-417d-bf00-093626ddb933 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:55.699923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e47f06c2-b56d-417d-bf00-093626ddb933 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:55.700697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e47f06c2-b56d-417d-bf00-093626ddb933 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:55.838874 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e47f06c2-b56d-417d-bf00-093626ddb933 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:55.847257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e47f06c2-b56d-417d-bf00-093626ddb933 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167467 Dec 15 16:46:55.847822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1411/2614] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:55 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:56.304739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-64d3c8cd-cacc-4178-8740-ceb21493ae05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:56.305804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-64d3c8cd-cacc-4178-8740-ceb21493ae05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:56.316330 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64d3c8cd-cacc-4178-8740-ceb21493ae05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:56.317146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64d3c8cd-cacc-4178-8740-ceb21493ae05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:56.318419 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64d3c8cd-cacc-4178-8740-ceb21493ae05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:56.319161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64d3c8cd-cacc-4178-8740-ceb21493ae05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:56.381280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-64d3c8cd-cacc-4178-8740-ceb21493ae05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:56.389522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-64d3c8cd-cacc-4178-8740-ceb21493ae05 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090950 Dec 15 16:46:56.390098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1204/2615] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:56.868685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0e9e20aa-ab44-4264-ab8d-38fe739d88a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:56.869675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0e9e20aa-ab44-4264-ab8d-38fe739d88a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:56.880291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e9e20aa-ab44-4264-ab8d-38fe739d88a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:56.881081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e9e20aa-ab44-4264-ab8d-38fe739d88a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:56.882496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e9e20aa-ab44-4264-ab8d-38fe739d88a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:56.883222 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e9e20aa-ab44-4264-ab8d-38fe739d88a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:57.031496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e9e20aa-ab44-4264-ab8d-38fe739d88a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:57.039739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0e9e20aa-ab44-4264-ab8d-38fe739d88a4 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.177448 Dec 15 16:46:57.040311 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1412/2616] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:56 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:57.410254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-23ae0974-26b3-43e5-8e7a-c0f25c1baaf5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:57.411199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-23ae0974-26b3-43e5-8e7a-c0f25c1baaf5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:57.422297 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23ae0974-26b3-43e5-8e7a-c0f25c1baaf5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:57.423042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23ae0974-26b3-43e5-8e7a-c0f25c1baaf5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:57.424342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23ae0974-26b3-43e5-8e7a-c0f25c1baaf5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:57.425364 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-23ae0974-26b3-43e5-8e7a-c0f25c1baaf5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:57.492752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-23ae0974-26b3-43e5-8e7a-c0f25c1baaf5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:57.500895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-23ae0974-26b3-43e5-8e7a-c0f25c1baaf5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097235 Dec 15 16:46:57.501465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1205/2617] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:58.057791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-41072112-bb2c-474c-95bb-07edf395bdf6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:58.058436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-41072112-bb2c-474c-95bb-07edf395bdf6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:58.065318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41072112-bb2c-474c-95bb-07edf395bdf6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:58.065776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41072112-bb2c-474c-95bb-07edf395bdf6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:58.066561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41072112-bb2c-474c-95bb-07edf395bdf6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:58.067000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41072112-bb2c-474c-95bb-07edf395bdf6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:58.212425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-41072112-bb2c-474c-95bb-07edf395bdf6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:58.221023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-41072112-bb2c-474c-95bb-07edf395bdf6 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166819 Dec 15 16:46:58.221606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1413/2618] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:58 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:58.521822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-96a266e8-dede-4b4c-bf74-8133fbace9bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:58.522774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-96a266e8-dede-4b4c-bf74-8133fbace9bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:58.533670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96a266e8-dede-4b4c-bf74-8133fbace9bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:58.534423 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96a266e8-dede-4b4c-bf74-8133fbace9bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:58.535711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96a266e8-dede-4b4c-bf74-8133fbace9bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:58.536497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96a266e8-dede-4b4c-bf74-8133fbace9bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:58.602358 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-96a266e8-dede-4b4c-bf74-8133fbace9bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:58.611080 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-96a266e8-dede-4b4c-bf74-8133fbace9bd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095468 Dec 15 16:46:58.611660 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1206/2619] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:46:59.242795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-66c1e997-5def-4e40-b717-b9b9769ae6ae tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:59.243774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-66c1e997-5def-4e40-b717-b9b9769ae6ae tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:59.254386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66c1e997-5def-4e40-b717-b9b9769ae6ae tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:59.255123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66c1e997-5def-4e40-b717-b9b9769ae6ae tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:59.256479 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66c1e997-5def-4e40-b717-b9b9769ae6ae tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:59.257230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-66c1e997-5def-4e40-b717-b9b9769ae6ae tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:59.400690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-66c1e997-5def-4e40-b717-b9b9769ae6ae tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:59.411982 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-66c1e997-5def-4e40-b717-b9b9769ae6ae tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.175246 Dec 15 16:46:59.412781 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1414/2620] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:59 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:46:59.632716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-637a1e3f-903d-4521-a80d-4f81c97a2973 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:46:59.633665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-637a1e3f-903d-4521-a80d-4f81c97a2973 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:46:59.644053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-637a1e3f-903d-4521-a80d-4f81c97a2973 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:59.644838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-637a1e3f-903d-4521-a80d-4f81c97a2973 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:59.646127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-637a1e3f-903d-4521-a80d-4f81c97a2973 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:46:59.646932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-637a1e3f-903d-4521-a80d-4f81c97a2973 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:46:59.713001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-637a1e3f-903d-4521-a80d-4f81c97a2973 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:46:59.722039 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-637a1e3f-903d-4521-a80d-4f81c97a2973 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095840 Dec 15 16:46:59.722614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1207/2621] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:46:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:00.433463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ae7dfd33-a997-44b0-a443-c80aa7b537cb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:00.434045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ae7dfd33-a997-44b0-a443-c80aa7b537cb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:00.442214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae7dfd33-a997-44b0-a443-c80aa7b537cb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:00.442669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae7dfd33-a997-44b0-a443-c80aa7b537cb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:00.443465 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae7dfd33-a997-44b0-a443-c80aa7b537cb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:00.443900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ae7dfd33-a997-44b0-a443-c80aa7b537cb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:00.597243 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ae7dfd33-a997-44b0-a443-c80aa7b537cb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:00.605990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ae7dfd33-a997-44b0-a443-c80aa7b537cb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.178627 Dec 15 16:47:00.606585 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1415/2622] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:00 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:00.740837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a37f8095-81d6-48d3-92c8-f815a0894423 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:00.741557 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a37f8095-81d6-48d3-92c8-f815a0894423 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:00.752227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a37f8095-81d6-48d3-92c8-f815a0894423 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:00.752786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a37f8095-81d6-48d3-92c8-f815a0894423 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:00.753872 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a37f8095-81d6-48d3-92c8-f815a0894423 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:00.754473 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a37f8095-81d6-48d3-92c8-f815a0894423 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:00.826416 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a37f8095-81d6-48d3-92c8-f815a0894423 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:00.835116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a37f8095-81d6-48d3-92c8-f815a0894423 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098234 Dec 15 16:47:00.835684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1208/2623] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:01.627035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1026b09c-7cd3-4cc8-8464-0148fe44f77a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:01.628062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1026b09c-7cd3-4cc8-8464-0148fe44f77a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:01.638962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1026b09c-7cd3-4cc8-8464-0148fe44f77a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:01.639713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1026b09c-7cd3-4cc8-8464-0148fe44f77a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:01.641069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1026b09c-7cd3-4cc8-8464-0148fe44f77a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:01.641531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1026b09c-7cd3-4cc8-8464-0148fe44f77a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:01.779526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1026b09c-7cd3-4cc8-8464-0148fe44f77a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:01.787705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1026b09c-7cd3-4cc8-8464-0148fe44f77a tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.166854 Dec 15 16:47:01.788282 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1416/2624] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:01 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:01.856249 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-20697070-f0cd-436c-861f-ffc4e4b91595 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:01.857324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-20697070-f0cd-436c-861f-ffc4e4b91595 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:01.867888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-20697070-f0cd-436c-861f-ffc4e4b91595 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:01.868695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-20697070-f0cd-436c-861f-ffc4e4b91595 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:01.869974 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-20697070-f0cd-436c-861f-ffc4e4b91595 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:01.870697 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-20697070-f0cd-436c-861f-ffc4e4b91595 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:01.933142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-20697070-f0cd-436c-861f-ffc4e4b91595 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:01.941511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-20697070-f0cd-436c-861f-ffc4e4b91595 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091296 Dec 15 16:47:01.942078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1209/2625] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:02.813360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3fd72f10-1484-4fd4-9ec0-c29138fa4b8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:02.814562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3fd72f10-1484-4fd4-9ec0-c29138fa4b8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:02.823894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fd72f10-1484-4fd4-9ec0-c29138fa4b8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:02.824713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fd72f10-1484-4fd4-9ec0-c29138fa4b8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:02.825989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fd72f10-1484-4fd4-9ec0-c29138fa4b8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:02.826703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fd72f10-1484-4fd4-9ec0-c29138fa4b8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:02.958123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f0a1d5c9-8b5c-4ed5-bf69-f1efcde288f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:02.958739 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f0a1d5c9-8b5c-4ed5-bf69-f1efcde288f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:02.966026 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3fd72f10-1484-4fd4-9ec0-c29138fa4b8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:02.967485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0a1d5c9-8b5c-4ed5-bf69-f1efcde288f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:02.967972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0a1d5c9-8b5c-4ed5-bf69-f1efcde288f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:02.968785 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0a1d5c9-8b5c-4ed5-bf69-f1efcde288f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:02.969315 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0a1d5c9-8b5c-4ed5-bf69-f1efcde288f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:02.974387 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3fd72f10-1484-4fd4-9ec0-c29138fa4b8e tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167007 Dec 15 16:47:02.974969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1417/2626] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:02 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:03.032141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f0a1d5c9-8b5c-4ed5-bf69-f1efcde288f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:03.039939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f0a1d5c9-8b5c-4ed5-bf69-f1efcde288f6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085565 Dec 15 16:47:03.040499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1210/2627] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:03.995642 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-86edfacb-cd1c-494c-93c2-ce8e1d6ca025 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:03.996678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-86edfacb-cd1c-494c-93c2-ce8e1d6ca025 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:04.005015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86edfacb-cd1c-494c-93c2-ce8e1d6ca025 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:04.005463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86edfacb-cd1c-494c-93c2-ce8e1d6ca025 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:04.006260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86edfacb-cd1c-494c-93c2-ce8e1d6ca025 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:04.006676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86edfacb-cd1c-494c-93c2-ce8e1d6ca025 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:04.056255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5ff0df72-3d1d-4326-93de-af08b421b21f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:04.057011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5ff0df72-3d1d-4326-93de-af08b421b21f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:04.064048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ff0df72-3d1d-4326-93de-af08b421b21f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:04.064523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ff0df72-3d1d-4326-93de-af08b421b21f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:04.065302 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ff0df72-3d1d-4326-93de-af08b421b21f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:04.065734 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ff0df72-3d1d-4326-93de-af08b421b21f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:04.133748 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5ff0df72-3d1d-4326-93de-af08b421b21f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:04.142202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5ff0df72-3d1d-4326-93de-af08b421b21f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089683 Dec 15 16:47:04.142781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1211/2628] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:04 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:04.161574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-86edfacb-cd1c-494c-93c2-ce8e1d6ca025 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:04.169832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-86edfacb-cd1c-494c-93c2-ce8e1d6ca025 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.180355 Dec 15 16:47:04.170366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1418/2629] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:03 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:04.425472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-acda4e9b-1536-46b4-96d5-bf1fa9837464 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:04.425994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-acda4e9b-1536-46b4-96d5-bf1fa9837464 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:04.432838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-acda4e9b-1536-46b4-96d5-bf1fa9837464 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:04.433305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-acda4e9b-1536-46b4-96d5-bf1fa9837464 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:04.434118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-acda4e9b-1536-46b4-96d5-bf1fa9837464 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:04.434565 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-acda4e9b-1536-46b4-96d5-bf1fa9837464 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:04.460967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-acda4e9b-1536-46b4-96d5-bf1fa9837464 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Going to try to terminate instance {{(pid=116022) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:47:04.538795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-acda4e9b-1536-46b4-96d5-bf1fa9837464 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 204 len: 0 microversion: 2.20 time: 0.118246 Dec 15 16:47:04.539425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1212/2630] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Dec 15 16:47:04 2021] DELETE /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:47:04.547607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:04.548565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:04.554659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:04.555102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:04.555882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:04.556320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:04.694283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:04.702516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:04.704352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:04.705606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-36a40b19-b481-49cc-bca1-987bcbcd8be0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1721 microversion: 2.20 time: 0.161786 Dec 15 16:47:04.706145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1419/2631] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:47:04 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:47:05.165107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-69283780-f75b-4f90-acb0-bf8cd974c87d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:05.166077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-69283780-f75b-4f90-acb0-bf8cd974c87d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:05.175802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-69283780-f75b-4f90-acb0-bf8cd974c87d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:05.176255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-69283780-f75b-4f90-acb0-bf8cd974c87d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:05.177071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-69283780-f75b-4f90-acb0-bf8cd974c87d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:05.177511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-69283780-f75b-4f90-acb0-bf8cd974c87d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:05.186954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5491636f-a326-4730-8be2-a34480906766 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:05.187567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5491636f-a326-4730-8be2-a34480906766 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:05.194779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5491636f-a326-4730-8be2-a34480906766 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:05.195229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5491636f-a326-4730-8be2-a34480906766 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:05.196012 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5491636f-a326-4730-8be2-a34480906766 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:05.196462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5491636f-a326-4730-8be2-a34480906766 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:05.242411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-69283780-f75b-4f90-acb0-bf8cd974c87d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:05.250753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-69283780-f75b-4f90-acb0-bf8cd974c87d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093248 Dec 15 16:47:05.252208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1213/2632] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:05.339530 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5491636f-a326-4730-8be2-a34480906766 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:05.349264 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5491636f-a326-4730-8be2-a34480906766 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.165951 Dec 15 16:47:05.349844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1420/2633] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:05 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:05.724738 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:05.725341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:05.731909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:05.732363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:05.733187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:05.733648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:05.872104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:05.881101 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:05.882607 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:05.883762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e1540c3a-9551-4765-97e1-c6fd6cd5991d tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1721 microversion: 2.20 time: 0.163226 Dec 15 16:47:05.884312 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1214/2634] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:47:05 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:47:06.268425 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d5fe88c3-dabf-472e-9cbf-5819c74a471c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:06.269204 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d5fe88c3-dabf-472e-9cbf-5819c74a471c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:06.275773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5fe88c3-dabf-472e-9cbf-5819c74a471c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:06.276230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5fe88c3-dabf-472e-9cbf-5819c74a471c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:06.277072 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5fe88c3-dabf-472e-9cbf-5819c74a471c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:06.277505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d5fe88c3-dabf-472e-9cbf-5819c74a471c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:06.348413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d5fe88c3-dabf-472e-9cbf-5819c74a471c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:06.356315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d5fe88c3-dabf-472e-9cbf-5819c74a471c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091651 Dec 15 16:47:06.356908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1421/2635] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:06.368313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-96b5621b-8468-4230-abbe-bb62a7d2405f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:06.369109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-96b5621b-8468-4230-abbe-bb62a7d2405f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:06.376122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96b5621b-8468-4230-abbe-bb62a7d2405f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:06.376692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96b5621b-8468-4230-abbe-bb62a7d2405f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:06.377581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96b5621b-8468-4230-abbe-bb62a7d2405f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:06.378015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-96b5621b-8468-4230-abbe-bb62a7d2405f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:06.623499 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-96b5621b-8468-4230-abbe-bb62a7d2405f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:06.631929 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-96b5621b-8468-4230-abbe-bb62a7d2405f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.268776 Dec 15 16:47:06.632664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1215/2636] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:06 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:06.864981 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-a977a1ae-7a74-4d45-80c1-617c523d6819 req-bae4095a-2081-4d55-9f6b-876562acc6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8bc1c9-bc61-4861-98f9-f0acbeba3219", "name": "network-vif-deleted", "tag": "9997c77e-4da9-4aed-96ce-4f8d7ead5391"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:47:06.867296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:47:06.867296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:47:06.876542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-a977a1ae-7a74-4d45-80c1-617c523d6819 req-bae4095a-2081-4d55-9f6b-876562acc6af service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:06.877238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-a977a1ae-7a74-4d45-80c1-617c523d6819 req-bae4095a-2081-4d55-9f6b-876562acc6af service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:06.889278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-a977a1ae-7a74-4d45-80c1-617c523d6819 req-bae4095a-2081-4d55-9f6b-876562acc6af service nova] Creating event network-vif-deleted:9997c77e-4da9-4aed-96ce-4f8d7ead5391 for instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 on hv-cinder-82002 Dec 15 16:47:06.895010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-a977a1ae-7a74-4d45-80c1-617c523d6819 req-bae4095a-2081-4d55-9f6b-876562acc6af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034559 Dec 15 16:47:06.895631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1422/2637] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:47:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:47:06.907388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:06.908573 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:06.920237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:06.921317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:06.922124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:06.922570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:07.014092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:07.022849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:07.024820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:07.026015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3bd59349-7f7f-4ec7-bfa4-a78c1b0480b0 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 200 len: 1364 microversion: 2.20 time: 0.125220 Dec 15 16:47:07.026576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1216/2638] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:47:06 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 1364 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:47:07.377322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c25f446a-b59d-417d-99db-4c4f0cea0c14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:07.378077 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c25f446a-b59d-417d-99db-4c4f0cea0c14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:07.384424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c25f446a-b59d-417d-99db-4c4f0cea0c14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:07.384912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c25f446a-b59d-417d-99db-4c4f0cea0c14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:07.385702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c25f446a-b59d-417d-99db-4c4f0cea0c14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:07.386152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c25f446a-b59d-417d-99db-4c4f0cea0c14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:07.446962 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c25f446a-b59d-417d-99db-4c4f0cea0c14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:07.455213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c25f446a-b59d-417d-99db-4c4f0cea0c14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.082655 Dec 15 16:47:07.455789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1423/2639] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:07.650521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e7b7dfa6-8633-4c0c-a31d-199ee866ba2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:07.651232 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e7b7dfa6-8633-4c0c-a31d-199ee866ba2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:07.658185 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7b7dfa6-8633-4c0c-a31d-199ee866ba2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:07.658644 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7b7dfa6-8633-4c0c-a31d-199ee866ba2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:07.659447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7b7dfa6-8633-4c0c-a31d-199ee866ba2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:07.659887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e7b7dfa6-8633-4c0c-a31d-199ee866ba2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:07.797105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e7b7dfa6-8633-4c0c-a31d-199ee866ba2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:07.805058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e7b7dfa6-8633-4c0c-a31d-199ee866ba2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.158292 Dec 15 16:47:07.805624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1217/2640] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:07 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:08.045392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-28612984-128e-45e9-8a55-9a1791e3f958 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:08.046020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-28612984-128e-45e9-8a55-9a1791e3f958 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:08.052661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28612984-128e-45e9-8a55-9a1791e3f958 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.053111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28612984-128e-45e9-8a55-9a1791e3f958 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.053885 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28612984-128e-45e9-8a55-9a1791e3f958 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.054312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-28612984-128e-45e9-8a55-9a1791e3f958 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.067990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-28612984-128e-45e9-8a55-9a1791e3f958 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] HTTP exception thrown: Instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 could not be found. Dec 15 16:47:08.068619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-28612984-128e-45e9-8a55-9a1791e3f958 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Returning 404 to user: Instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:47:08.069456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-28612984-128e-45e9-8a55-9a1791e3f958 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 404 len: 111 microversion: 2.20 time: 0.027902 Dec 15 16:47:08.069987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1424/2641] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:47:08 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:47:08.078611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa9562a5-e456-44b4-83b8-84cbfe3ef934 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '.version_select at 0x7f3a6f776d30>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:08.099332 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa9562a5-e456-44b4-83b8-84cbfe3ef934 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-85624778" status: 204 len: 0 microversion: 2.20 time: 0.024410 Dec 15 16:47:08.099892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1218/2642] 10.222.0.30 () {60 vars in 1255 bytes} [Wed Dec 15 16:47:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-85624778 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:47:08.473216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6ec2fb4a-6ce9-41fa-9269-c506caa65557 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:08.473786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6ec2fb4a-6ce9-41fa-9269-c506caa65557 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:08.480590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6ec2fb4a-6ce9-41fa-9269-c506caa65557 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.481083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6ec2fb4a-6ce9-41fa-9269-c506caa65557 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.481880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6ec2fb4a-6ce9-41fa-9269-c506caa65557 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.482320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6ec2fb4a-6ce9-41fa-9269-c506caa65557 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.544001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6ec2fb4a-6ce9-41fa-9269-c506caa65557 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:08.552097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6ec2fb4a-6ce9-41fa-9269-c506caa65557 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083286 Dec 15 16:47:08.552722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1425/2643] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:08.792754 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7ce79b84-37f7-48a1-8e8f-500f01b50da7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:08.793272 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7ce79b84-37f7-48a1-8e8f-500f01b50da7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:08.799727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ce79b84-37f7-48a1-8e8f-500f01b50da7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.800166 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ce79b84-37f7-48a1-8e8f-500f01b50da7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.800979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ce79b84-37f7-48a1-8e8f-500f01b50da7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.801409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ce79b84-37f7-48a1-8e8f-500f01b50da7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.814663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-7ce79b84-37f7-48a1-8e8f-500f01b50da7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] HTTP exception thrown: Instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 could not be found. Dec 15 16:47:08.815238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7ce79b84-37f7-48a1-8e8f-500f01b50da7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Returning 404 to user: Instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:47:08.816053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7ce79b84-37f7-48a1-8e8f-500f01b50da7 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 404 len: 111 microversion: 2.20 time: 0.078636 Dec 15 16:47:08.816610 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1219/2644] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Dec 15 16:47:08 2021] DELETE /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:47:08.822474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b5f45184-a731-49da-bfbc-62ea93173c8f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:08.823113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b5f45184-a731-49da-bfbc-62ea93173c8f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:08.824031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4885a0ed-923d-4f5b-a94f-9a504e5410fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:08.824651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4885a0ed-923d-4f5b-a94f-9a504e5410fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: ed8bc1c9-bc61-4861-98f9-f0acbeba3219] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:08.829601 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b5f45184-a731-49da-bfbc-62ea93173c8f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.830085 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b5f45184-a731-49da-bfbc-62ea93173c8f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.830520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4885a0ed-923d-4f5b-a94f-9a504e5410fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.830887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4885a0ed-923d-4f5b-a94f-9a504e5410fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.831159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b5f45184-a731-49da-bfbc-62ea93173c8f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.831605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b5f45184-a731-49da-bfbc-62ea93173c8f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.831722 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4885a0ed-923d-4f5b-a94f-9a504e5410fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:08.832065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4885a0ed-923d-4f5b-a94f-9a504e5410fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:08.845123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-4885a0ed-923d-4f5b-a94f-9a504e5410fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] HTTP exception thrown: Instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 could not be found. Dec 15 16:47:08.846087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4885a0ed-923d-4f5b-a94f-9a504e5410fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Returning 404 to user: Instance ed8bc1c9-bc61-4861-98f9-f0acbeba3219 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:47:08.846906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4885a0ed-923d-4f5b-a94f-9a504e5410fc tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219" status: 404 len: 111 microversion: 2.20 time: 0.026346 Dec 15 16:47:08.847454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1220/2645] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:47:08 2021] GET /compute/v2.1/servers/ed8bc1c9-bc61-4861-98f9-f0acbeba3219 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 16:47:08.974402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b5f45184-a731-49da-bfbc-62ea93173c8f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:08.982643 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b5f45184-a731-49da-bfbc-62ea93173c8f tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.163913 Dec 15 16:47:08.983184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1426/2646] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:08 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:09.573790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f51b718c-e4e5-425d-b799-53815c283ea9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:09.574838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f51b718c-e4e5-425d-b799-53815c283ea9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:09.583113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f51b718c-e4e5-425d-b799-53815c283ea9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:09.583558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f51b718c-e4e5-425d-b799-53815c283ea9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:09.584330 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f51b718c-e4e5-425d-b799-53815c283ea9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:09.584793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f51b718c-e4e5-425d-b799-53815c283ea9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:09.653116 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f51b718c-e4e5-425d-b799-53815c283ea9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:09.661411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f51b718c-e4e5-425d-b799-53815c283ea9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093778 Dec 15 16:47:09.661968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1221/2647] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:10.003440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1a589f60-1af4-4e0b-b75d-5e685e630685 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:10.004150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1a589f60-1af4-4e0b-b75d-5e685e630685 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:10.012252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a589f60-1af4-4e0b-b75d-5e685e630685 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:10.012854 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a589f60-1af4-4e0b-b75d-5e685e630685 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:10.013826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a589f60-1af4-4e0b-b75d-5e685e630685 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:10.014361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1a589f60-1af4-4e0b-b75d-5e685e630685 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:10.157273 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1a589f60-1af4-4e0b-b75d-5e685e630685 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:10.165542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1a589f60-1af4-4e0b-b75d-5e685e630685 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.167999 Dec 15 16:47:10.166134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1427/2648] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:09 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:10.679661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e8bb518a-a6ae-426a-a1b3-e94bda1bcd02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:10.680263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e8bb518a-a6ae-426a-a1b3-e94bda1bcd02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:10.689295 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8bb518a-a6ae-426a-a1b3-e94bda1bcd02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:10.689912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8bb518a-a6ae-426a-a1b3-e94bda1bcd02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:10.690712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8bb518a-a6ae-426a-a1b3-e94bda1bcd02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:10.691150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e8bb518a-a6ae-426a-a1b3-e94bda1bcd02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:10.763967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e8bb518a-a6ae-426a-a1b3-e94bda1bcd02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:10.772543 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e8bb518a-a6ae-426a-a1b3-e94bda1bcd02 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098440 Dec 15 16:47:10.773119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1222/2649] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:11.184793 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-41d09859-dabf-46f5-b087-d18b6aef31dd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:11.185675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-41d09859-dabf-46f5-b087-d18b6aef31dd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:11.195328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41d09859-dabf-46f5-b087-d18b6aef31dd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:11.195993 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41d09859-dabf-46f5-b087-d18b6aef31dd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:11.197269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41d09859-dabf-46f5-b087-d18b6aef31dd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:11.197911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-41d09859-dabf-46f5-b087-d18b6aef31dd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:11.343477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-41d09859-dabf-46f5-b087-d18b6aef31dd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:11.356487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-41d09859-dabf-46f5-b087-d18b6aef31dd tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.177103 Dec 15 16:47:11.357280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1428/2650] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:11 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:11.794261 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-383a1091-43d3-4c0f-82ee-6bb7e2a06b22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:11.795307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-383a1091-43d3-4c0f-82ee-6bb7e2a06b22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:11.803460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-383a1091-43d3-4c0f-82ee-6bb7e2a06b22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:11.803913 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-383a1091-43d3-4c0f-82ee-6bb7e2a06b22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:11.804733 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-383a1091-43d3-4c0f-82ee-6bb7e2a06b22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:11.805172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-383a1091-43d3-4c0f-82ee-6bb7e2a06b22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:11.874288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-383a1091-43d3-4c0f-82ee-6bb7e2a06b22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:11.884891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-383a1091-43d3-4c0f-82ee-6bb7e2a06b22 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096979 Dec 15 16:47:11.885495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1223/2651] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:12.378847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a735e6ed-3a91-4a30-a99e-091052d3ad18 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:12.379503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a735e6ed-3a91-4a30-a99e-091052d3ad18 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:12.387165 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a735e6ed-3a91-4a30-a99e-091052d3ad18 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:12.387685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a735e6ed-3a91-4a30-a99e-091052d3ad18 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:12.388636 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a735e6ed-3a91-4a30-a99e-091052d3ad18 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:12.389184 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a735e6ed-3a91-4a30-a99e-091052d3ad18 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:12.538746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a735e6ed-3a91-4a30-a99e-091052d3ad18 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:12.549998 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a735e6ed-3a91-4a30-a99e-091052d3ad18 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.176937 Dec 15 16:47:12.550569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1429/2652] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:12 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:12.906290 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f3319311-ca10-4333-8d16-f2eb55f77230 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:12.907288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f3319311-ca10-4333-8d16-f2eb55f77230 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:12.914454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3319311-ca10-4333-8d16-f2eb55f77230 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:12.914900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3319311-ca10-4333-8d16-f2eb55f77230 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:12.915681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3319311-ca10-4333-8d16-f2eb55f77230 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:12.916115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f3319311-ca10-4333-8d16-f2eb55f77230 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:12.983344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f3319311-ca10-4333-8d16-f2eb55f77230 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:12.991505 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f3319311-ca10-4333-8d16-f2eb55f77230 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091422 Dec 15 16:47:12.992078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1224/2653] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:13.571015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a8e78895-4e2d-4b68-a677-82902ba025a2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:13.571976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a8e78895-4e2d-4b68-a677-82902ba025a2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:13.581960 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a8e78895-4e2d-4b68-a677-82902ba025a2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:13.582412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a8e78895-4e2d-4b68-a677-82902ba025a2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:13.583194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a8e78895-4e2d-4b68-a677-82902ba025a2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:13.583625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a8e78895-4e2d-4b68-a677-82902ba025a2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:13.728092 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a8e78895-4e2d-4b68-a677-82902ba025a2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:13.739935 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a8e78895-4e2d-4b68-a677-82902ba025a2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.174973 Dec 15 16:47:13.740789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1430/2654] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:13 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:14.009659 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-747e75cd-7686-4742-a9d4-de52ae2a63e6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:14.010205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-747e75cd-7686-4742-a9d4-de52ae2a63e6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:14.016916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-747e75cd-7686-4742-a9d4-de52ae2a63e6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:14.017343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-747e75cd-7686-4742-a9d4-de52ae2a63e6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:14.018451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-747e75cd-7686-4742-a9d4-de52ae2a63e6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:14.018892 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-747e75cd-7686-4742-a9d4-de52ae2a63e6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:14.090541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-747e75cd-7686-4742-a9d4-de52ae2a63e6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:14.102313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-747e75cd-7686-4742-a9d4-de52ae2a63e6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096768 Dec 15 16:47:14.102850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1225/2655] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:14 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:14.760334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-44cf6fc7-57b9-4edc-b539-ea5093aa5d60 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:14.761209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-44cf6fc7-57b9-4edc-b539-ea5093aa5d60 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:14.770134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44cf6fc7-57b9-4edc-b539-ea5093aa5d60 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:14.770580 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44cf6fc7-57b9-4edc-b539-ea5093aa5d60 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:14.771365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44cf6fc7-57b9-4edc-b539-ea5093aa5d60 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:14.771795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-44cf6fc7-57b9-4edc-b539-ea5093aa5d60 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:14.915838 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-44cf6fc7-57b9-4edc-b539-ea5093aa5d60 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:14.924855 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-44cf6fc7-57b9-4edc-b539-ea5093aa5d60 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170367 Dec 15 16:47:14.925429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1431/2656] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:14 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:15.124079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f0638f10-b347-479f-aa90-49354b4aad63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:15.125073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f0638f10-b347-479f-aa90-49354b4aad63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:15.135638 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0638f10-b347-479f-aa90-49354b4aad63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:15.136387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0638f10-b347-479f-aa90-49354b4aad63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:15.137725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0638f10-b347-479f-aa90-49354b4aad63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:15.138449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f0638f10-b347-479f-aa90-49354b4aad63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:15.199740 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f0638f10-b347-479f-aa90-49354b4aad63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:15.207725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f0638f10-b347-479f-aa90-49354b4aad63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089837 Dec 15 16:47:15.208284 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1226/2657] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:15.945597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-bfe4bec8-5b1f-476f-baba-629b44dd6e19 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:15.946590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-bfe4bec8-5b1f-476f-baba-629b44dd6e19 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:15.957252 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bfe4bec8-5b1f-476f-baba-629b44dd6e19 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:15.957989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bfe4bec8-5b1f-476f-baba-629b44dd6e19 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:15.959281 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bfe4bec8-5b1f-476f-baba-629b44dd6e19 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:15.960013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-bfe4bec8-5b1f-476f-baba-629b44dd6e19 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:16.101577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-bfe4bec8-5b1f-476f-baba-629b44dd6e19 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:16.112322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-bfe4bec8-5b1f-476f-baba-629b44dd6e19 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172696 Dec 15 16:47:16.113197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1432/2658] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:15 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:16.226237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f93ae410-8db3-4bc9-a04e-fe223c3a7c21 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:16.226870 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f93ae410-8db3-4bc9-a04e-fe223c3a7c21 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:16.233582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f93ae410-8db3-4bc9-a04e-fe223c3a7c21 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:16.234023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f93ae410-8db3-4bc9-a04e-fe223c3a7c21 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:16.234798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f93ae410-8db3-4bc9-a04e-fe223c3a7c21 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:16.235227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f93ae410-8db3-4bc9-a04e-fe223c3a7c21 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:16.299708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f93ae410-8db3-4bc9-a04e-fe223c3a7c21 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:16.308099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f93ae410-8db3-4bc9-a04e-fe223c3a7c21 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085587 Dec 15 16:47:16.308718 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1227/2659] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:16 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:17.136602 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3fa854bb-19b5-4cd4-8c4d-9834a438de2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:17.137644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3fa854bb-19b5-4cd4-8c4d-9834a438de2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:17.147220 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fa854bb-19b5-4cd4-8c4d-9834a438de2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:17.147705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fa854bb-19b5-4cd4-8c4d-9834a438de2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:17.148514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fa854bb-19b5-4cd4-8c4d-9834a438de2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:17.148977 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3fa854bb-19b5-4cd4-8c4d-9834a438de2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:17.292864 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3fa854bb-19b5-4cd4-8c4d-9834a438de2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:17.300844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3fa854bb-19b5-4cd4-8c4d-9834a438de2d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170500 Dec 15 16:47:17.301428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1433/2660] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:17 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:17.327535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0b8e0827-ca2c-43e6-9a1c-e5923053b345 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:17.328719 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0b8e0827-ca2c-43e6-9a1c-e5923053b345 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:17.336589 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b8e0827-ca2c-43e6-9a1c-e5923053b345 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:17.337040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b8e0827-ca2c-43e6-9a1c-e5923053b345 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:17.337828 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b8e0827-ca2c-43e6-9a1c-e5923053b345 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:17.338263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0b8e0827-ca2c-43e6-9a1c-e5923053b345 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:17.401110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0b8e0827-ca2c-43e6-9a1c-e5923053b345 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:17.415996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0b8e0827-ca2c-43e6-9a1c-e5923053b345 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093863 Dec 15 16:47:17.416981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1228/2661] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:18.322546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2e806767-d7db-43c1-974c-9e9ae9748710 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:18.323557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2e806767-d7db-43c1-974c-9e9ae9748710 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:18.334557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e806767-d7db-43c1-974c-9e9ae9748710 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:18.335296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e806767-d7db-43c1-974c-9e9ae9748710 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:18.336627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e806767-d7db-43c1-974c-9e9ae9748710 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:18.337343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2e806767-d7db-43c1-974c-9e9ae9748710 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:18.441253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-00f2533c-7465-4af5-bf07-9f7f719dc49d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:18.442408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-00f2533c-7465-4af5-bf07-9f7f719dc49d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:18.450814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00f2533c-7465-4af5-bf07-9f7f719dc49d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:18.451259 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00f2533c-7465-4af5-bf07-9f7f719dc49d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:18.452181 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00f2533c-7465-4af5-bf07-9f7f719dc49d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:18.452666 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-00f2533c-7465-4af5-bf07-9f7f719dc49d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:18.490890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2e806767-d7db-43c1-974c-9e9ae9748710 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:18.499259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2e806767-d7db-43c1-974c-9e9ae9748710 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.183203 Dec 15 16:47:18.499850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1434/2662] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:18 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:18.518127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-00f2533c-7465-4af5-bf07-9f7f719dc49d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:18.526504 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-00f2533c-7465-4af5-bf07-9f7f719dc49d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089907 Dec 15 16:47:18.527073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1229/2663] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:19.520389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-59656251-2bb1-4cbf-8f1b-490d63690d95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:19.521319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-59656251-2bb1-4cbf-8f1b-490d63690d95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:19.531964 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59656251-2bb1-4cbf-8f1b-490d63690d95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:19.532790 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59656251-2bb1-4cbf-8f1b-490d63690d95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:19.534104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59656251-2bb1-4cbf-8f1b-490d63690d95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:19.534809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-59656251-2bb1-4cbf-8f1b-490d63690d95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:19.545495 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ea0e20bb-d4f5-497e-9e4a-c5034f56ec6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:19.546369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ea0e20bb-d4f5-497e-9e4a-c5034f56ec6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:19.554199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea0e20bb-d4f5-497e-9e4a-c5034f56ec6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:19.554648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea0e20bb-d4f5-497e-9e4a-c5034f56ec6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:19.555425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea0e20bb-d4f5-497e-9e4a-c5034f56ec6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:19.555853 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ea0e20bb-d4f5-497e-9e4a-c5034f56ec6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:19.628753 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ea0e20bb-d4f5-497e-9e4a-c5034f56ec6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:19.636907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ea0e20bb-d4f5-497e-9e4a-c5034f56ec6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096554 Dec 15 16:47:19.637481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1230/2664] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:19 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:19.692567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-59656251-2bb1-4cbf-8f1b-490d63690d95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:19.700581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-59656251-2bb1-4cbf-8f1b-490d63690d95 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.186815 Dec 15 16:47:19.701151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1435/2665] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:19 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:20.654147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8eca6c2b-4566-4322-92c2-83cc3b0f0155 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:20.654782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8eca6c2b-4566-4322-92c2-83cc3b0f0155 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:20.661781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8eca6c2b-4566-4322-92c2-83cc3b0f0155 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:20.662288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8eca6c2b-4566-4322-92c2-83cc3b0f0155 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:20.663045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8eca6c2b-4566-4322-92c2-83cc3b0f0155 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:20.663487 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8eca6c2b-4566-4322-92c2-83cc3b0f0155 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:20.721621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5b48f1e6-0d4a-423f-8454-3a2c853c03a7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:20.722574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5b48f1e6-0d4a-423f-8454-3a2c853c03a7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:20.729127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b48f1e6-0d4a-423f-8454-3a2c853c03a7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:20.729651 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b48f1e6-0d4a-423f-8454-3a2c853c03a7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:20.730507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b48f1e6-0d4a-423f-8454-3a2c853c03a7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:20.731015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5b48f1e6-0d4a-423f-8454-3a2c853c03a7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:20.735705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8eca6c2b-4566-4322-92c2-83cc3b0f0155 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:20.743923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8eca6c2b-4566-4322-92c2-83cc3b0f0155 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093528 Dec 15 16:47:20.744497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1231/2666] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:20 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:20.885002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5b48f1e6-0d4a-423f-8454-3a2c853c03a7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:20.896291 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5b48f1e6-0d4a-423f-8454-3a2c853c03a7 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.181241 Dec 15 16:47:20.896916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1436/2667] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:20 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:47:21.765380 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0fce3127-e5e0-43f7-a797-0a62fe6f1d27 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:21.766340 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0fce3127-e5e0-43f7-a797-0a62fe6f1d27 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:21.774873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0fce3127-e5e0-43f7-a797-0a62fe6f1d27 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:21.775322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0fce3127-e5e0-43f7-a797-0a62fe6f1d27 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:21.776093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0fce3127-e5e0-43f7-a797-0a62fe6f1d27 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:21.776628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0fce3127-e5e0-43f7-a797-0a62fe6f1d27 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:21.835503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0fce3127-e5e0-43f7-a797-0a62fe6f1d27 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:21.846484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0fce3127-e5e0-43f7-a797-0a62fe6f1d27 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086637 Dec 15 16:47:21.847335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1232/2668] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:21.914968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eeb01f34-701b-45bd-9a01-42c25bb4edeb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:21.915546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eeb01f34-701b-45bd-9a01-42c25bb4edeb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:21.922432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eeb01f34-701b-45bd-9a01-42c25bb4edeb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:21.922887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eeb01f34-701b-45bd-9a01-42c25bb4edeb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:21.923672 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eeb01f34-701b-45bd-9a01-42c25bb4edeb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:21.924102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eeb01f34-701b-45bd-9a01-42c25bb4edeb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:22.063597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eeb01f34-701b-45bd-9a01-42c25bb4edeb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:22.072330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eeb01f34-701b-45bd-9a01-42c25bb4edeb tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.161938 Dec 15 16:47:22.072948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1437/2669] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:21 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:22.868876 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa1dff7c-7b88-4ac1-8380-7b7092dce85a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:22.869868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa1dff7c-7b88-4ac1-8380-7b7092dce85a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:22.880558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa1dff7c-7b88-4ac1-8380-7b7092dce85a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:22.881006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa1dff7c-7b88-4ac1-8380-7b7092dce85a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:22.881782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa1dff7c-7b88-4ac1-8380-7b7092dce85a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:22.882218 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa1dff7c-7b88-4ac1-8380-7b7092dce85a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:22.941426 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa1dff7c-7b88-4ac1-8380-7b7092dce85a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:22.949767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa1dff7c-7b88-4ac1-8380-7b7092dce85a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087582 Dec 15 16:47:22.950331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1233/2670] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:23.093436 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-27dd9e87-54fc-479b-b82d-1ac774e20bf9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:23.094843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-27dd9e87-54fc-479b-b82d-1ac774e20bf9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:23.101023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:47:23.101326 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:47:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 (ip 10.222.0.30) !!! Dec 15 16:47:23.119293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27dd9e87-54fc-479b-b82d-1ac774e20bf9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:23.119677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27dd9e87-54fc-479b-b82d-1ac774e20bf9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:23.120686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27dd9e87-54fc-479b-b82d-1ac774e20bf9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:23.121432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-27dd9e87-54fc-479b-b82d-1ac774e20bf9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:23.259570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-27dd9e87-54fc-479b-b82d-1ac774e20bf9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:23.267909 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-27dd9e87-54fc-479b-b82d-1ac774e20bf9 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.180771 Dec 15 16:47:23.268551 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1438/2671] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:23 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:23.968999 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8ed8f608-f919-462e-84d8-2484a062f8a0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:23.969829 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8ed8f608-f919-462e-84d8-2484a062f8a0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:23.978359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8ed8f608-f919-462e-84d8-2484a062f8a0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:23.979001 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8ed8f608-f919-462e-84d8-2484a062f8a0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:23.979997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8ed8f608-f919-462e-84d8-2484a062f8a0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:23.980761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8ed8f608-f919-462e-84d8-2484a062f8a0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:24.041270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8ed8f608-f919-462e-84d8-2484a062f8a0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:24.049299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8ed8f608-f919-462e-84d8-2484a062f8a0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085029 Dec 15 16:47:24.049861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1234/2672] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:23 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:24.289142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-402b8b44-f5c5-4c88-88d6-82355ac9a178 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:24.289873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-402b8b44-f5c5-4c88-88d6-82355ac9a178 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:24.298625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-402b8b44-f5c5-4c88-88d6-82355ac9a178 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:24.299226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-402b8b44-f5c5-4c88-88d6-82355ac9a178 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:24.300278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-402b8b44-f5c5-4c88-88d6-82355ac9a178 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:24.300900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-402b8b44-f5c5-4c88-88d6-82355ac9a178 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:24.447055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-402b8b44-f5c5-4c88-88d6-82355ac9a178 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:24.455023 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-402b8b44-f5c5-4c88-88d6-82355ac9a178 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.172075 Dec 15 16:47:24.455576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1439/2673] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:24 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:25.068131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-04eb91cb-a5a7-45c2-b7f9-d6ec0a1eca88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:25.069055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-04eb91cb-a5a7-45c2-b7f9-d6ec0a1eca88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:25.077437 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04eb91cb-a5a7-45c2-b7f9-d6ec0a1eca88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:25.078006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04eb91cb-a5a7-45c2-b7f9-d6ec0a1eca88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:25.078983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04eb91cb-a5a7-45c2-b7f9-d6ec0a1eca88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:25.079535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-04eb91cb-a5a7-45c2-b7f9-d6ec0a1eca88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:25.145214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-04eb91cb-a5a7-45c2-b7f9-d6ec0a1eca88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:25.153298 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-04eb91cb-a5a7-45c2-b7f9-d6ec0a1eca88 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089973 Dec 15 16:47:25.153865 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1235/2674] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:25 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:25.475182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-77f9fecd-ce75-4902-b946-cbec4c546e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:25.475911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-77f9fecd-ce75-4902-b946-cbec4c546e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:25.484572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77f9fecd-ce75-4902-b946-cbec4c546e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:25.485161 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77f9fecd-ce75-4902-b946-cbec4c546e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:25.486188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77f9fecd-ce75-4902-b946-cbec4c546e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:25.486776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-77f9fecd-ce75-4902-b946-cbec4c546e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:25.623124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-77f9fecd-ce75-4902-b946-cbec4c546e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:25.632261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-77f9fecd-ce75-4902-b946-cbec4c546e84 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.162244 Dec 15 16:47:25.633143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1440/2675] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:25 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:26.171201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-79c7b1a4-4eb9-445a-a9dc-9b73560e3c04 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:26.171908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-79c7b1a4-4eb9-445a-a9dc-9b73560e3c04 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:26.178649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79c7b1a4-4eb9-445a-a9dc-9b73560e3c04 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:26.179095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79c7b1a4-4eb9-445a-a9dc-9b73560e3c04 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:26.180082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79c7b1a4-4eb9-445a-a9dc-9b73560e3c04 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:26.180562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-79c7b1a4-4eb9-445a-a9dc-9b73560e3c04 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:26.246383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-79c7b1a4-4eb9-445a-a9dc-9b73560e3c04 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:26.254552 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-79c7b1a4-4eb9-445a-a9dc-9b73560e3c04 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087985 Dec 15 16:47:26.255147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1236/2676] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:26.655347 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d6dd3b07-36fd-4bfd-adb8-cea08d79fed2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:26.656294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d6dd3b07-36fd-4bfd-adb8-cea08d79fed2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:26.665314 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6dd3b07-36fd-4bfd-adb8-cea08d79fed2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:26.665763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6dd3b07-36fd-4bfd-adb8-cea08d79fed2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:26.666538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6dd3b07-36fd-4bfd-adb8-cea08d79fed2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:26.666969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d6dd3b07-36fd-4bfd-adb8-cea08d79fed2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:26.805477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-d6dd3b07-36fd-4bfd-adb8-cea08d79fed2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:26.813819 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d6dd3b07-36fd-4bfd-adb8-cea08d79fed2 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.165124 Dec 15 16:47:26.814391 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1441/2677] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:26 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:27.276311 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c3cd2658-da9b-4f24-829d-9e3f161b8d61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:27.277291 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c3cd2658-da9b-4f24-829d-9e3f161b8d61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:27.287526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3cd2658-da9b-4f24-829d-9e3f161b8d61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:27.288000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3cd2658-da9b-4f24-829d-9e3f161b8d61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:27.288804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3cd2658-da9b-4f24-829d-9e3f161b8d61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:27.289250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c3cd2658-da9b-4f24-829d-9e3f161b8d61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:27.363906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c3cd2658-da9b-4f24-829d-9e3f161b8d61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:27.372325 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c3cd2658-da9b-4f24-829d-9e3f161b8d61 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.102365 Dec 15 16:47:27.372973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1237/2678] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:27 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:27.834594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2d414877-1453-4cbe-9755-cfb33f222e45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:27.835560 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2d414877-1453-4cbe-9755-cfb33f222e45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:27.846734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d414877-1453-4cbe-9755-cfb33f222e45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:27.847470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d414877-1453-4cbe-9755-cfb33f222e45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:27.848843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d414877-1453-4cbe-9755-cfb33f222e45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:27.849487 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2d414877-1453-4cbe-9755-cfb33f222e45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:27.987549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2d414877-1453-4cbe-9755-cfb33f222e45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:27.999521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2d414877-1453-4cbe-9755-cfb33f222e45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.170935 Dec 15 16:47:28.000312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1442/2679] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:27 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:28.394167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7d7c8bde-7cd1-45d1-b4e6-52b1151f2674 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:28.394987 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7d7c8bde-7cd1-45d1-b4e6-52b1151f2674 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:28.402334 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d7c8bde-7cd1-45d1-b4e6-52b1151f2674 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:28.402795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d7c8bde-7cd1-45d1-b4e6-52b1151f2674 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:28.403635 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d7c8bde-7cd1-45d1-b4e6-52b1151f2674 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:28.404091 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d7c8bde-7cd1-45d1-b4e6-52b1151f2674 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:28.475497 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7d7c8bde-7cd1-45d1-b4e6-52b1151f2674 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:28.483889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7d7c8bde-7cd1-45d1-b4e6-52b1151f2674 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096049 Dec 15 16:47:28.484472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1238/2680] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:29.021134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c2ab3170-67a7-45c7-adda-2952465831e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:29.021726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c2ab3170-67a7-45c7-adda-2952465831e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:29.028492 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2ab3170-67a7-45c7-adda-2952465831e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:29.028966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2ab3170-67a7-45c7-adda-2952465831e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:29.029746 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2ab3170-67a7-45c7-adda-2952465831e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:29.030178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c2ab3170-67a7-45c7-adda-2952465831e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:29.175352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c2ab3170-67a7-45c7-adda-2952465831e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:29.183509 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c2ab3170-67a7-45c7-adda-2952465831e5 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.168658 Dec 15 16:47:29.184087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1443/2681] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:29 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:29.505805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-375e6618-d2ed-493d-a0aa-e468ed002c6c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:29.505805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-375e6618-d2ed-493d-a0aa-e468ed002c6c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:29.512462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-375e6618-d2ed-493d-a0aa-e468ed002c6c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:29.512939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-375e6618-d2ed-493d-a0aa-e468ed002c6c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:29.513731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-375e6618-d2ed-493d-a0aa-e468ed002c6c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:29.514164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-375e6618-d2ed-493d-a0aa-e468ed002c6c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:29.577033 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-375e6618-d2ed-493d-a0aa-e468ed002c6c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:29.584964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-375e6618-d2ed-493d-a0aa-e468ed002c6c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086193 Dec 15 16:47:29.585559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1239/2682] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:30.204816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6ec803e8-a0ff-48de-af95-dcd07c5a341c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:30.205749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6ec803e8-a0ff-48de-af95-dcd07c5a341c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:30.216640 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6ec803e8-a0ff-48de-af95-dcd07c5a341c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:30.217582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6ec803e8-a0ff-48de-af95-dcd07c5a341c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:30.219006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6ec803e8-a0ff-48de-af95-dcd07c5a341c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:30.219827 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6ec803e8-a0ff-48de-af95-dcd07c5a341c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:30.364741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6ec803e8-a0ff-48de-af95-dcd07c5a341c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:30.376633 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6ec803e8-a0ff-48de-af95-dcd07c5a341c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.177629 Dec 15 16:47:30.377397 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1444/2683] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:30 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:30.606017 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e6c490b5-da48-4346-a63b-1668325d3ba3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:30.606918 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e6c490b5-da48-4346-a63b-1668325d3ba3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:30.615715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e6c490b5-da48-4346-a63b-1668325d3ba3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:30.616168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e6c490b5-da48-4346-a63b-1668325d3ba3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:30.616979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e6c490b5-da48-4346-a63b-1668325d3ba3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:30.617411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e6c490b5-da48-4346-a63b-1668325d3ba3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:30.650091 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:47:30.650326 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:47:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:47:30.679756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e6c490b5-da48-4346-a63b-1668325d3ba3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:30.687783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e6c490b5-da48-4346-a63b-1668325d3ba3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087854 Dec 15 16:47:30.688347 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1240/2684] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:31.398676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-26ca91ba-6cf8-44f5-90fd-3c673f0ddf7d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:31.399307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-26ca91ba-6cf8-44f5-90fd-3c673f0ddf7d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:31.406582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26ca91ba-6cf8-44f5-90fd-3c673f0ddf7d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:31.407069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26ca91ba-6cf8-44f5-90fd-3c673f0ddf7d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:31.407932 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26ca91ba-6cf8-44f5-90fd-3c673f0ddf7d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:31.408368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-26ca91ba-6cf8-44f5-90fd-3c673f0ddf7d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:31.549688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-26ca91ba-6cf8-44f5-90fd-3c673f0ddf7d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:31.562344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-26ca91ba-6cf8-44f5-90fd-3c673f0ddf7d tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.169595 Dec 15 16:47:31.563108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1445/2685] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:31 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:31.705128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0943d6fa-8864-4fdf-b35b-af23f7fdd37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:31.705680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0943d6fa-8864-4fdf-b35b-af23f7fdd37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:31.714400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0943d6fa-8864-4fdf-b35b-af23f7fdd37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:31.714850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0943d6fa-8864-4fdf-b35b-af23f7fdd37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:31.715636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0943d6fa-8864-4fdf-b35b-af23f7fdd37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:31.716067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0943d6fa-8864-4fdf-b35b-af23f7fdd37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:31.779148 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0943d6fa-8864-4fdf-b35b-af23f7fdd37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:31.787115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0943d6fa-8864-4fdf-b35b-af23f7fdd37e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085901 Dec 15 16:47:31.787695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1241/2686] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:32.585811 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-de09bf1b-cfa7-4ba2-ab4d-87fe6b628d45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:32.586695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-de09bf1b-cfa7-4ba2-ab4d-87fe6b628d45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:32.594061 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de09bf1b-cfa7-4ba2-ab4d-87fe6b628d45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:32.594779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de09bf1b-cfa7-4ba2-ab4d-87fe6b628d45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:32.596496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de09bf1b-cfa7-4ba2-ab4d-87fe6b628d45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:32.597239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-de09bf1b-cfa7-4ba2-ab4d-87fe6b628d45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:32.804906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-39205e11-d449-457c-9ddc-09325db8dc24 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:32.805562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-39205e11-d449-457c-9ddc-09325db8dc24 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:32.812475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39205e11-d449-457c-9ddc-09325db8dc24 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:32.812938 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39205e11-d449-457c-9ddc-09325db8dc24 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:32.813749 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39205e11-d449-457c-9ddc-09325db8dc24 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:32.814187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-39205e11-d449-457c-9ddc-09325db8dc24 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:32.978514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-39205e11-d449-457c-9ddc-09325db8dc24 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:32.986771 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-39205e11-d449-457c-9ddc-09325db8dc24 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.185897 Dec 15 16:47:32.987356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1242/2687] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:33.018613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-de09bf1b-cfa7-4ba2-ab4d-87fe6b628d45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:33.029809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-de09bf1b-cfa7-4ba2-ab4d-87fe6b628d45 tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.449873 Dec 15 16:47:33.030624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1446/2688] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:32 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:34.006410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fe2c0373-94f0-4a7c-9fcc-62eaddadc30b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:34.007279 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fe2c0373-94f0-4a7c-9fcc-62eaddadc30b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:34.014193 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe2c0373-94f0-4a7c-9fcc-62eaddadc30b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:34.014650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe2c0373-94f0-4a7c-9fcc-62eaddadc30b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:34.015626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe2c0373-94f0-4a7c-9fcc-62eaddadc30b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:34.016057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fe2c0373-94f0-4a7c-9fcc-62eaddadc30b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:34.047115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8123f271-5f5c-4ef9-8741-e943bb60f80c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:34.047710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8123f271-5f5c-4ef9-8741-e943bb60f80c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] [instance: 96293447-9fd5-4150-abbe-a00f77eb0094] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:34.054420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8123f271-5f5c-4ef9-8741-e943bb60f80c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:34.054880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8123f271-5f5c-4ef9-8741-e943bb60f80c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:34.055705 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8123f271-5f5c-4ef9-8741-e943bb60f80c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:34.056277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8123f271-5f5c-4ef9-8741-e943bb60f80c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:34.077235 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fe2c0373-94f0-4a7c-9fcc-62eaddadc30b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:34.085569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fe2c0373-94f0-4a7c-9fcc-62eaddadc30b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083952 Dec 15 16:47:34.086152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1243/2689] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:34.191849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8123f271-5f5c-4ef9-8741-e943bb60f80c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '525625cf3f3a4381a828f58b8ac056f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce9eb0396d945e692eb72ae3f344a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:34.204608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8123f271-5f5c-4ef9-8741-e943bb60f80c tempest-VolumesSnapshotTestJSON-1494700391 tempest-VolumesSnapshotTestJSON-1494700391-project] 10.222.0.30 "GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094" status: 200 len: 1559 microversion: 2.1 time: 0.160848 Dec 15 16:47:34.205430 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1447/2690] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:34 2021] GET /compute/v2.1/servers/96293447-9fd5-4150-abbe-a00f77eb0094 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:35.103046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e3dd833a-3e82-4899-969f-f2208009230d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:35.105395 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e3dd833a-3e82-4899-969f-f2208009230d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:35.112222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3dd833a-3e82-4899-969f-f2208009230d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:35.112696 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3dd833a-3e82-4899-969f-f2208009230d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:35.113517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3dd833a-3e82-4899-969f-f2208009230d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:35.113922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e3dd833a-3e82-4899-969f-f2208009230d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:35.176648 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e3dd833a-3e82-4899-969f-f2208009230d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:35.186530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e3dd833a-3e82-4899-969f-f2208009230d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087673 Dec 15 16:47:35.187266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1244/2691] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:36.207832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b49aff9d-2429-4bf3-8744-683eb7029af2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:36.209086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b49aff9d-2429-4bf3-8744-683eb7029af2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:36.219767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b49aff9d-2429-4bf3-8744-683eb7029af2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:36.220946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b49aff9d-2429-4bf3-8744-683eb7029af2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:36.222223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b49aff9d-2429-4bf3-8744-683eb7029af2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:36.222913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b49aff9d-2429-4bf3-8744-683eb7029af2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:36.285447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b49aff9d-2429-4bf3-8744-683eb7029af2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:36.293608 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b49aff9d-2429-4bf3-8744-683eb7029af2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092097 Dec 15 16:47:36.294162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1448/2692] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:37.314113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-db515ffa-6d50-4348-80f9-da706fd93196 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:37.315131 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-db515ffa-6d50-4348-80f9-da706fd93196 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:37.326361 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db515ffa-6d50-4348-80f9-da706fd93196 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:37.327103 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db515ffa-6d50-4348-80f9-da706fd93196 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:37.328391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db515ffa-6d50-4348-80f9-da706fd93196 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:37.329195 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db515ffa-6d50-4348-80f9-da706fd93196 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:37.395028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-db515ffa-6d50-4348-80f9-da706fd93196 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:37.405260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-db515ffa-6d50-4348-80f9-da706fd93196 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097405 Dec 15 16:47:37.405869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1245/2693] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:38.426238 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4eab4c32-3ac2-4750-b6e2-5bcd6a6301e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:38.427105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4eab4c32-3ac2-4750-b6e2-5bcd6a6301e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:38.438525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eab4c32-3ac2-4750-b6e2-5bcd6a6301e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:38.439309 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eab4c32-3ac2-4750-b6e2-5bcd6a6301e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:38.440783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eab4c32-3ac2-4750-b6e2-5bcd6a6301e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:38.441572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4eab4c32-3ac2-4750-b6e2-5bcd6a6301e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:38.503908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4eab4c32-3ac2-4750-b6e2-5bcd6a6301e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:38.513049 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4eab4c32-3ac2-4750-b6e2-5bcd6a6301e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093052 Dec 15 16:47:38.513625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1449/2694] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:39.539149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-80e771a0-cdc3-4f70-93ef-69daf0ba96e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:39.540075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-80e771a0-cdc3-4f70-93ef-69daf0ba96e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:39.551396 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80e771a0-cdc3-4f70-93ef-69daf0ba96e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:39.552142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80e771a0-cdc3-4f70-93ef-69daf0ba96e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:39.553468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80e771a0-cdc3-4f70-93ef-69daf0ba96e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:39.554196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-80e771a0-cdc3-4f70-93ef-69daf0ba96e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:39.628219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-80e771a0-cdc3-4f70-93ef-69daf0ba96e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:39.636559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-80e771a0-cdc3-4f70-93ef-69daf0ba96e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.103825 Dec 15 16:47:39.637128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1246/2695] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:39 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:40.657915 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5ab36817-cbef-45f5-a6e5-7117c5ac95ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:40.658541 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5ab36817-cbef-45f5-a6e5-7117c5ac95ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:40.665706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ab36817-cbef-45f5-a6e5-7117c5ac95ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:40.666148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ab36817-cbef-45f5-a6e5-7117c5ac95ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:40.666923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ab36817-cbef-45f5-a6e5-7117c5ac95ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:40.667349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5ab36817-cbef-45f5-a6e5-7117c5ac95ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:40.729894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5ab36817-cbef-45f5-a6e5-7117c5ac95ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:40.738192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5ab36817-cbef-45f5-a6e5-7117c5ac95ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088279 Dec 15 16:47:40.738768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1450/2696] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:41.759011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-836521ac-2388-4389-a7a6-1fa2d1f21143 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:41.760364 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-836521ac-2388-4389-a7a6-1fa2d1f21143 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:41.771014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-836521ac-2388-4389-a7a6-1fa2d1f21143 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:41.771751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-836521ac-2388-4389-a7a6-1fa2d1f21143 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:41.773086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-836521ac-2388-4389-a7a6-1fa2d1f21143 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:41.773801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-836521ac-2388-4389-a7a6-1fa2d1f21143 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:41.834585 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-836521ac-2388-4389-a7a6-1fa2d1f21143 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:41.842602 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-836521ac-2388-4389-a7a6-1fa2d1f21143 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089852 Dec 15 16:47:41.843163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1247/2697] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:42.863844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8f9214b0-a63e-41e3-85ca-d211bf883899 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:42.865125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8f9214b0-a63e-41e3-85ca-d211bf883899 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:42.876766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8f9214b0-a63e-41e3-85ca-d211bf883899 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:42.877522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8f9214b0-a63e-41e3-85ca-d211bf883899 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:42.878801 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8f9214b0-a63e-41e3-85ca-d211bf883899 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:42.879521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8f9214b0-a63e-41e3-85ca-d211bf883899 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:42.950413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8f9214b0-a63e-41e3-85ca-d211bf883899 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:42.962953 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8f9214b0-a63e-41e3-85ca-d211bf883899 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.104907 Dec 15 16:47:42.963758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1451/2698] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:43.988224 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b414c062-9b07-461c-bbfb-1aa2408373e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:43.989309 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b414c062-9b07-461c-bbfb-1aa2408373e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:43.997592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b414c062-9b07-461c-bbfb-1aa2408373e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:43.998140 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b414c062-9b07-461c-bbfb-1aa2408373e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:43.998926 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b414c062-9b07-461c-bbfb-1aa2408373e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:43.999360 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b414c062-9b07-461c-bbfb-1aa2408373e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:44.066757 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b414c062-9b07-461c-bbfb-1aa2408373e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:44.075004 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b414c062-9b07-461c-bbfb-1aa2408373e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092157 Dec 15 16:47:44.075580 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1248/2699] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:45.092776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9a2189cf-d8bb-44d9-a519-533969eb2ca3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:45.093446 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9a2189cf-d8bb-44d9-a519-533969eb2ca3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:45.101257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a2189cf-d8bb-44d9-a519-533969eb2ca3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:45.101756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a2189cf-d8bb-44d9-a519-533969eb2ca3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:45.102700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a2189cf-d8bb-44d9-a519-533969eb2ca3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:45.103194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9a2189cf-d8bb-44d9-a519-533969eb2ca3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:45.163083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9a2189cf-d8bb-44d9-a519-533969eb2ca3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:45.171548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9a2189cf-d8bb-44d9-a519-533969eb2ca3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.082931 Dec 15 16:47:45.172078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1452/2700] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:46.192774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ec59c6f7-fc95-491f-a34e-0ca9bbd09bdb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:46.193799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ec59c6f7-fc95-491f-a34e-0ca9bbd09bdb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:46.204712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec59c6f7-fc95-491f-a34e-0ca9bbd09bdb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:46.205453 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec59c6f7-fc95-491f-a34e-0ca9bbd09bdb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:46.206827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec59c6f7-fc95-491f-a34e-0ca9bbd09bdb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:46.207548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ec59c6f7-fc95-491f-a34e-0ca9bbd09bdb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:46.271703 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ec59c6f7-fc95-491f-a34e-0ca9bbd09bdb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:46.280146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ec59c6f7-fc95-491f-a34e-0ca9bbd09bdb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093726 Dec 15 16:47:46.280761 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1249/2701] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:47.309257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-17dce245-dfe9-4a58-b61b-0d9ea1e56f83 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:47.309966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-17dce245-dfe9-4a58-b61b-0d9ea1e56f83 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:47.318579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17dce245-dfe9-4a58-b61b-0d9ea1e56f83 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:47.319021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17dce245-dfe9-4a58-b61b-0d9ea1e56f83 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:47.319804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17dce245-dfe9-4a58-b61b-0d9ea1e56f83 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:47.320232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-17dce245-dfe9-4a58-b61b-0d9ea1e56f83 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:47.397539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-17dce245-dfe9-4a58-b61b-0d9ea1e56f83 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:47.409563 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-17dce245-dfe9-4a58-b61b-0d9ea1e56f83 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.106785 Dec 15 16:47:47.410315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1453/2702] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:47 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:48.431939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-417f1d7c-ae34-4f44-9fb4-69f78906a79f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:48.432583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-417f1d7c-ae34-4f44-9fb4-69f78906a79f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:48.439196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-417f1d7c-ae34-4f44-9fb4-69f78906a79f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:48.439653 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-417f1d7c-ae34-4f44-9fb4-69f78906a79f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:48.440459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-417f1d7c-ae34-4f44-9fb4-69f78906a79f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:48.440902 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-417f1d7c-ae34-4f44-9fb4-69f78906a79f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:48.506392 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-417f1d7c-ae34-4f44-9fb4-69f78906a79f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:48.515212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-417f1d7c-ae34-4f44-9fb4-69f78906a79f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089374 Dec 15 16:47:48.515783 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1250/2703] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:49.536772 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7b1f8478-89af-475e-a482-09ef74a65d00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:49.537665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7b1f8478-89af-475e-a482-09ef74a65d00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:49.545510 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b1f8478-89af-475e-a482-09ef74a65d00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:49.545973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b1f8478-89af-475e-a482-09ef74a65d00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:49.546743 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b1f8478-89af-475e-a482-09ef74a65d00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:49.547178 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7b1f8478-89af-475e-a482-09ef74a65d00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:49.606729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7b1f8478-89af-475e-a482-09ef74a65d00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:49.614782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7b1f8478-89af-475e-a482-09ef74a65d00 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084337 Dec 15 16:47:49.615340 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1454/2704] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:50.633521 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-99136e47-88b2-4637-a068-93e3bc1ca089 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:50.634260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-99136e47-88b2-4637-a068-93e3bc1ca089 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:50.641461 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-99136e47-88b2-4637-a068-93e3bc1ca089 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:50.641916 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-99136e47-88b2-4637-a068-93e3bc1ca089 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:50.642708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-99136e47-88b2-4637-a068-93e3bc1ca089 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:50.643142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-99136e47-88b2-4637-a068-93e3bc1ca089 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:50.709827 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-99136e47-88b2-4637-a068-93e3bc1ca089 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:50.721939 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-99136e47-88b2-4637-a068-93e3bc1ca089 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092975 Dec 15 16:47:50.723016 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1251/2705] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:51.746470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6cc03dc3-da7a-4a2c-9771-e03615571779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:51.747766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6cc03dc3-da7a-4a2c-9771-e03615571779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:51.758290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cc03dc3-da7a-4a2c-9771-e03615571779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:51.759013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cc03dc3-da7a-4a2c-9771-e03615571779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:51.760315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cc03dc3-da7a-4a2c-9771-e03615571779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:51.761081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6cc03dc3-da7a-4a2c-9771-e03615571779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:51.826458 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6cc03dc3-da7a-4a2c-9771-e03615571779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:51.834906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6cc03dc3-da7a-4a2c-9771-e03615571779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094499 Dec 15 16:47:51.835456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1455/2706] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:52.855993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-99fd6310-da83-4688-8449-50c006960c89 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:52.857090 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-99fd6310-da83-4688-8449-50c006960c89 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:52.867856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-99fd6310-da83-4688-8449-50c006960c89 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:52.868671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-99fd6310-da83-4688-8449-50c006960c89 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:52.869972 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-99fd6310-da83-4688-8449-50c006960c89 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:52.870749 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-99fd6310-da83-4688-8449-50c006960c89 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:52.933674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-99fd6310-da83-4688-8449-50c006960c89 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:52.942105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-99fd6310-da83-4688-8449-50c006960c89 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092309 Dec 15 16:47:52.942679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1252/2707] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:53.962559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b0527e22-d566-42ba-b806-20cafd43789f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:53.963449 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b0527e22-d566-42ba-b806-20cafd43789f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:53.973969 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b0527e22-d566-42ba-b806-20cafd43789f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:53.974657 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b0527e22-d566-42ba-b806-20cafd43789f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:53.975839 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b0527e22-d566-42ba-b806-20cafd43789f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:53.976543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b0527e22-d566-42ba-b806-20cafd43789f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:54.041043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b0527e22-d566-42ba-b806-20cafd43789f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:54.049173 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b0527e22-d566-42ba-b806-20cafd43789f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092271 Dec 15 16:47:54.049692 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1456/2708] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:53 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:55.070265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-326aa555-1336-44ee-9604-383575ac1b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:55.071369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-326aa555-1336-44ee-9604-383575ac1b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:55.082459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-326aa555-1336-44ee-9604-383575ac1b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:55.083200 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-326aa555-1336-44ee-9604-383575ac1b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:55.084586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-326aa555-1336-44ee-9604-383575ac1b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:55.085317 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-326aa555-1336-44ee-9604-383575ac1b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:55.166115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-326aa555-1336-44ee-9604-383575ac1b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:55.174164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-326aa555-1336-44ee-9604-383575ac1b62 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.110142 Dec 15 16:47:55.174725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1253/2709] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:56.194850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6a3199ac-0181-42ed-a15f-62b2c26fe7fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:56.195710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6a3199ac-0181-42ed-a15f-62b2c26fe7fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:56.204103 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a3199ac-0181-42ed-a15f-62b2c26fe7fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:56.204578 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a3199ac-0181-42ed-a15f-62b2c26fe7fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:56.205349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a3199ac-0181-42ed-a15f-62b2c26fe7fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:56.205776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6a3199ac-0181-42ed-a15f-62b2c26fe7fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:56.266848 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6a3199ac-0181-42ed-a15f-62b2c26fe7fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:56.274878 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6a3199ac-0181-42ed-a15f-62b2c26fe7fe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086063 Dec 15 16:47:56.275441 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1457/2710] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:57.295932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cbf3ee3d-fa37-4a27-9ee8-d2514b7f1367 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:57.297149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cbf3ee3d-fa37-4a27-9ee8-d2514b7f1367 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:57.307704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cbf3ee3d-fa37-4a27-9ee8-d2514b7f1367 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:57.308490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cbf3ee3d-fa37-4a27-9ee8-d2514b7f1367 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:57.309862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cbf3ee3d-fa37-4a27-9ee8-d2514b7f1367 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:57.310454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cbf3ee3d-fa37-4a27-9ee8-d2514b7f1367 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:57.383704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cbf3ee3d-fa37-4a27-9ee8-d2514b7f1367 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:57.395996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cbf3ee3d-fa37-4a27-9ee8-d2514b7f1367 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.105904 Dec 15 16:47:57.396887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1254/2711] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:58.419906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b6a037f7-203f-4aa6-80c9-11ec1aacf5e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:58.420607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b6a037f7-203f-4aa6-80c9-11ec1aacf5e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:58.428709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6a037f7-203f-4aa6-80c9-11ec1aacf5e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:58.429269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6a037f7-203f-4aa6-80c9-11ec1aacf5e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:58.430239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6a037f7-203f-4aa6-80c9-11ec1aacf5e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:58.430785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6a037f7-203f-4aa6-80c9-11ec1aacf5e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:58.499732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b6a037f7-203f-4aa6-80c9-11ec1aacf5e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:58.508143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b6a037f7-203f-4aa6-80c9-11ec1aacf5e9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094700 Dec 15 16:47:58.508731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1458/2712] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:47:59.262065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:47:59.263150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:47:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:47:59.529426 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a1bad88c-d7e6-4312-a900-358a158b2190 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:47:59.530046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a1bad88c-d7e6-4312-a900-358a158b2190 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:47:59.537875 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a1bad88c-d7e6-4312-a900-358a158b2190 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:59.538399 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a1bad88c-d7e6-4312-a900-358a158b2190 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:59.539307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a1bad88c-d7e6-4312-a900-358a158b2190 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:47:59.539817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a1bad88c-d7e6-4312-a900-358a158b2190 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:47:59.605206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a1bad88c-d7e6-4312-a900-358a158b2190 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:47:59.613788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a1bad88c-d7e6-4312-a900-358a158b2190 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090712 Dec 15 16:47:59.614356 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1255/2713] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:47:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:00.636574 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-faed0e43-4c6f-4e49-a1e7-fb75749c5158 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:00.637621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-faed0e43-4c6f-4e49-a1e7-fb75749c5158 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:00.644890 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-faed0e43-4c6f-4e49-a1e7-fb75749c5158 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:00.645334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-faed0e43-4c6f-4e49-a1e7-fb75749c5158 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:00.646113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-faed0e43-4c6f-4e49-a1e7-fb75749c5158 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:00.646539 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-faed0e43-4c6f-4e49-a1e7-fb75749c5158 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:00.708060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-faed0e43-4c6f-4e49-a1e7-fb75749c5158 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:00.716629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-faed0e43-4c6f-4e49-a1e7-fb75749c5158 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087487 Dec 15 16:48:00.717199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1459/2714] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:01.738321 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ecd08204-85b8-4696-8596-55cc7ed580e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:01.739434 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ecd08204-85b8-4696-8596-55cc7ed580e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:01.748898 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ecd08204-85b8-4696-8596-55cc7ed580e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:01.749350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ecd08204-85b8-4696-8596-55cc7ed580e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:01.750136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ecd08204-85b8-4696-8596-55cc7ed580e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:01.750574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ecd08204-85b8-4696-8596-55cc7ed580e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:01.810932 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ecd08204-85b8-4696-8596-55cc7ed580e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:01.819253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ecd08204-85b8-4696-8596-55cc7ed580e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087352 Dec 15 16:48:01.819822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1256/2715] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:02.836597 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1d43cb5b-fd6a-4768-85b7-a0bb01d7385e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:02.837272 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1d43cb5b-fd6a-4768-85b7-a0bb01d7385e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:02.845083 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d43cb5b-fd6a-4768-85b7-a0bb01d7385e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:02.845537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d43cb5b-fd6a-4768-85b7-a0bb01d7385e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:02.846363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d43cb5b-fd6a-4768-85b7-a0bb01d7385e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:02.846798 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1d43cb5b-fd6a-4768-85b7-a0bb01d7385e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:02.916905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1d43cb5b-fd6a-4768-85b7-a0bb01d7385e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:02.926334 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1d43cb5b-fd6a-4768-85b7-a0bb01d7385e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093455 Dec 15 16:48:02.926932 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1460/2716] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:03.947420 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9a898e69-c9c3-47fd-a96d-102bcc711c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:03.948400 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9a898e69-c9c3-47fd-a96d-102bcc711c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:03.959743 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a898e69-c9c3-47fd-a96d-102bcc711c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:03.960818 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a898e69-c9c3-47fd-a96d-102bcc711c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:03.962141 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a898e69-c9c3-47fd-a96d-102bcc711c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:03.962855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9a898e69-c9c3-47fd-a96d-102bcc711c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:04.038330 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9a898e69-c9c3-47fd-a96d-102bcc711c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:04.046805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9a898e69-c9c3-47fd-a96d-102bcc711c9b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.105736 Dec 15 16:48:04.047369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1257/2717] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:05.071027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2abf5360-d2f7-4277-be37-a86ddfd562bf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:05.072027 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2abf5360-d2f7-4277-be37-a86ddfd562bf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:05.081420 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2abf5360-d2f7-4277-be37-a86ddfd562bf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:05.081899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2abf5360-d2f7-4277-be37-a86ddfd562bf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:05.082682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2abf5360-d2f7-4277-be37-a86ddfd562bf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:05.083115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2abf5360-d2f7-4277-be37-a86ddfd562bf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:05.148709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2abf5360-d2f7-4277-be37-a86ddfd562bf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:05.157467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2abf5360-d2f7-4277-be37-a86ddfd562bf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092691 Dec 15 16:48:05.158062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1461/2718] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:06.184996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c032d8f2-7989-4843-84c6-8b3991413ae9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:06.185588 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c032d8f2-7989-4843-84c6-8b3991413ae9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:06.192345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c032d8f2-7989-4843-84c6-8b3991413ae9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:06.192842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c032d8f2-7989-4843-84c6-8b3991413ae9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:06.193618 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c032d8f2-7989-4843-84c6-8b3991413ae9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:06.194051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c032d8f2-7989-4843-84c6-8b3991413ae9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:06.255767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c032d8f2-7989-4843-84c6-8b3991413ae9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:06.264612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c032d8f2-7989-4843-84c6-8b3991413ae9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085675 Dec 15 16:48:06.265168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1258/2719] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:07.286275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c48ec189-db14-463b-8b6d-ea929790715f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:07.286897 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c48ec189-db14-463b-8b6d-ea929790715f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:07.293741 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c48ec189-db14-463b-8b6d-ea929790715f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:07.294207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c48ec189-db14-463b-8b6d-ea929790715f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:07.295213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c48ec189-db14-463b-8b6d-ea929790715f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:07.295644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c48ec189-db14-463b-8b6d-ea929790715f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:07.369617 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c48ec189-db14-463b-8b6d-ea929790715f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:07.381952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c48ec189-db14-463b-8b6d-ea929790715f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098902 Dec 15 16:48:07.382775 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1462/2720] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:08.408933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eb572289-9777-4785-bf6a-7d05ce84bdfb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:08.409864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eb572289-9777-4785-bf6a-7d05ce84bdfb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:08.424520 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb572289-9777-4785-bf6a-7d05ce84bdfb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:08.431812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb572289-9777-4785-bf6a-7d05ce84bdfb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:08.437245 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb572289-9777-4785-bf6a-7d05ce84bdfb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:08.438285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eb572289-9777-4785-bf6a-7d05ce84bdfb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:08.514904 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eb572289-9777-4785-bf6a-7d05ce84bdfb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:08.523006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eb572289-9777-4785-bf6a-7d05ce84bdfb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.123452 Dec 15 16:48:08.523564 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1259/2721] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:09.545459 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5f99f2d3-af53-4f23-b33e-c75dcdc4f1c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:09.546052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5f99f2d3-af53-4f23-b33e-c75dcdc4f1c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:09.552804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f99f2d3-af53-4f23-b33e-c75dcdc4f1c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:09.553254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f99f2d3-af53-4f23-b33e-c75dcdc4f1c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:09.554042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f99f2d3-af53-4f23-b33e-c75dcdc4f1c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:09.554475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f99f2d3-af53-4f23-b33e-c75dcdc4f1c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:09.614784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5f99f2d3-af53-4f23-b33e-c75dcdc4f1c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:09.623328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5f99f2d3-af53-4f23-b33e-c75dcdc4f1c6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084172 Dec 15 16:48:09.623895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1463/2722] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:10.752790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3db00946-535b-4b54-ae3e-576aef98e9fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:10.753409 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3db00946-535b-4b54-ae3e-576aef98e9fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:10.759895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3db00946-535b-4b54-ae3e-576aef98e9fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:10.760341 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3db00946-535b-4b54-ae3e-576aef98e9fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:10.761144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3db00946-535b-4b54-ae3e-576aef98e9fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:10.761574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3db00946-535b-4b54-ae3e-576aef98e9fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:10.821046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3db00946-535b-4b54-ae3e-576aef98e9fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:10.829000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3db00946-535b-4b54-ae3e-576aef98e9fb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.190433 Dec 15 16:48:10.829574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1260/2723] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:11.849325 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6fc167a4-5fde-49a0-b2c0-b1c3f85f83c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:11.850330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6fc167a4-5fde-49a0-b2c0-b1c3f85f83c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:11.859532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fc167a4-5fde-49a0-b2c0-b1c3f85f83c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:11.859987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fc167a4-5fde-49a0-b2c0-b1c3f85f83c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:11.860894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fc167a4-5fde-49a0-b2c0-b1c3f85f83c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:11.861328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6fc167a4-5fde-49a0-b2c0-b1c3f85f83c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:11.932659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6fc167a4-5fde-49a0-b2c0-b1c3f85f83c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:11.941198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6fc167a4-5fde-49a0-b2c0-b1c3f85f83c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098197 Dec 15 16:48:11.941765 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1464/2724] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:12.965844 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8cdca94a-d4f9-42fd-a648-c4bb69b4dd14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:12.966813 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8cdca94a-d4f9-42fd-a648-c4bb69b4dd14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:12.974812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8cdca94a-d4f9-42fd-a648-c4bb69b4dd14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:12.975273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8cdca94a-d4f9-42fd-a648-c4bb69b4dd14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:12.976058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8cdca94a-d4f9-42fd-a648-c4bb69b4dd14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:12.976526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8cdca94a-d4f9-42fd-a648-c4bb69b4dd14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:13.044651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8cdca94a-d4f9-42fd-a648-c4bb69b4dd14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:13.057277 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8cdca94a-d4f9-42fd-a648-c4bb69b4dd14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097455 Dec 15 16:48:13.057879 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1261/2725] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:14.074844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4c066fce-6860-450a-835c-577f8314d596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:14.075447 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4c066fce-6860-450a-835c-577f8314d596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:14.082318 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c066fce-6860-450a-835c-577f8314d596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:14.082769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c066fce-6860-450a-835c-577f8314d596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:14.083549 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c066fce-6860-450a-835c-577f8314d596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:14.083986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4c066fce-6860-450a-835c-577f8314d596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:14.156800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4c066fce-6860-450a-835c-577f8314d596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:14.165130 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4c066fce-6860-450a-835c-577f8314d596 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094061 Dec 15 16:48:14.165698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1465/2726] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:14 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:15.186237 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4b058cbb-5de3-4c36-8c30-4170ee5dd5f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:15.187239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4b058cbb-5de3-4c36-8c30-4170ee5dd5f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:15.195352 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b058cbb-5de3-4c36-8c30-4170ee5dd5f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:15.195799 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b058cbb-5de3-4c36-8c30-4170ee5dd5f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:15.196613 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b058cbb-5de3-4c36-8c30-4170ee5dd5f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:15.197040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4b058cbb-5de3-4c36-8c30-4170ee5dd5f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:15.256707 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4b058cbb-5de3-4c36-8c30-4170ee5dd5f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:15.264678 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4b058cbb-5de3-4c36-8c30-4170ee5dd5f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084624 Dec 15 16:48:15.265236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1262/2727] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:16.283406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-ce5dde3e-c54a-4576-8f26-c026d8e785ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:16.284154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-ce5dde3e-c54a-4576-8f26-c026d8e785ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:16.292404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce5dde3e-c54a-4576-8f26-c026d8e785ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:16.293003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce5dde3e-c54a-4576-8f26-c026d8e785ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:16.293965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce5dde3e-c54a-4576-8f26-c026d8e785ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:16.294500 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-ce5dde3e-c54a-4576-8f26-c026d8e785ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:16.355987 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-ce5dde3e-c54a-4576-8f26-c026d8e785ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:16.364470 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-ce5dde3e-c54a-4576-8f26-c026d8e785ba tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085687 Dec 15 16:48:16.365043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1466/2728] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:16 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:17.385983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f133b9de-6a76-4422-8439-453ced71f433 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:17.386859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f133b9de-6a76-4422-8439-453ced71f433 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:17.398057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f133b9de-6a76-4422-8439-453ced71f433 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:17.398807 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f133b9de-6a76-4422-8439-453ced71f433 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:17.400107 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f133b9de-6a76-4422-8439-453ced71f433 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:17.400881 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f133b9de-6a76-4422-8439-453ced71f433 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:17.465143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f133b9de-6a76-4422-8439-453ced71f433 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:17.474111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f133b9de-6a76-4422-8439-453ced71f433 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094780 Dec 15 16:48:17.474679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1263/2729] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:18.500916 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-aef1a63b-4f63-48d0-a177-482135ca7438 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:18.501867 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-aef1a63b-4f63-48d0-a177-482135ca7438 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:18.512584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aef1a63b-4f63-48d0-a177-482135ca7438 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:18.513343 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aef1a63b-4f63-48d0-a177-482135ca7438 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:18.514625 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aef1a63b-4f63-48d0-a177-482135ca7438 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:18.515329 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-aef1a63b-4f63-48d0-a177-482135ca7438 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:18.576744 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-aef1a63b-4f63-48d0-a177-482135ca7438 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:18.584990 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-aef1a63b-4f63-48d0-a177-482135ca7438 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090576 Dec 15 16:48:18.585564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1467/2730] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:19.607708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-178e9d64-28d0-4d7b-ab5c-5f0573bbb1be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:19.608735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-178e9d64-28d0-4d7b-ab5c-5f0573bbb1be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:19.619713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-178e9d64-28d0-4d7b-ab5c-5f0573bbb1be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:19.620485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-178e9d64-28d0-4d7b-ab5c-5f0573bbb1be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:19.621805 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-178e9d64-28d0-4d7b-ab5c-5f0573bbb1be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:19.622535 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-178e9d64-28d0-4d7b-ab5c-5f0573bbb1be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:19.684917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-178e9d64-28d0-4d7b-ab5c-5f0573bbb1be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:19.693503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-178e9d64-28d0-4d7b-ab5c-5f0573bbb1be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091959 Dec 15 16:48:19.694075 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1264/2731] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:19 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:20.712875 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-89b89291-a1b0-4ca8-9cb9-57426ca6fa6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:20.713634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-89b89291-a1b0-4ca8-9cb9-57426ca6fa6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:20.722143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-89b89291-a1b0-4ca8-9cb9-57426ca6fa6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:20.722679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-89b89291-a1b0-4ca8-9cb9-57426ca6fa6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:20.723689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-89b89291-a1b0-4ca8-9cb9-57426ca6fa6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:20.724236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-89b89291-a1b0-4ca8-9cb9-57426ca6fa6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:20.793262 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-89b89291-a1b0-4ca8-9cb9-57426ca6fa6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:20.801346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-89b89291-a1b0-4ca8-9cb9-57426ca6fa6e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093193 Dec 15 16:48:20.801923 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1468/2732] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:20 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:21.822649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ef8e5e79-1734-4e3d-a61b-57bc8f481f2e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:21.823636 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ef8e5e79-1734-4e3d-a61b-57bc8f481f2e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:21.834891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ef8e5e79-1734-4e3d-a61b-57bc8f481f2e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:21.835626 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ef8e5e79-1734-4e3d-a61b-57bc8f481f2e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:21.836975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ef8e5e79-1734-4e3d-a61b-57bc8f481f2e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:21.837695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ef8e5e79-1734-4e3d-a61b-57bc8f481f2e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:21.901781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ef8e5e79-1734-4e3d-a61b-57bc8f481f2e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:21.910060 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ef8e5e79-1734-4e3d-a61b-57bc8f481f2e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093375 Dec 15 16:48:21.910650 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1265/2733] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:22.929707 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-98991f16-3223-4cef-b13e-c672f6ccf7f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:22.930454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-98991f16-3223-4cef-b13e-c672f6ccf7f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:22.938045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-98991f16-3223-4cef-b13e-c672f6ccf7f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:22.938567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-98991f16-3223-4cef-b13e-c672f6ccf7f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:22.939472 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-98991f16-3223-4cef-b13e-c672f6ccf7f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:22.939978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-98991f16-3223-4cef-b13e-c672f6ccf7f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:23.014410 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-98991f16-3223-4cef-b13e-c672f6ccf7f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:23.024740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-98991f16-3223-4cef-b13e-c672f6ccf7f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099992 Dec 15 16:48:23.025308 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1469/2734] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:24.047501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2251c1ff-ae4c-4cef-a074-e9375c92e799 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:24.048150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2251c1ff-ae4c-4cef-a074-e9375c92e799 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:24.055855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2251c1ff-ae4c-4cef-a074-e9375c92e799 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:24.056362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2251c1ff-ae4c-4cef-a074-e9375c92e799 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:24.057222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2251c1ff-ae4c-4cef-a074-e9375c92e799 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:24.057679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2251c1ff-ae4c-4cef-a074-e9375c92e799 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:24.124100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2251c1ff-ae4c-4cef-a074-e9375c92e799 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:24.133435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2251c1ff-ae4c-4cef-a074-e9375c92e799 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089936 Dec 15 16:48:24.134008 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1266/2735] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:24 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:25.159542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3e704008-5a8b-411d-970e-997f4adaf3c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:25.160667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3e704008-5a8b-411d-970e-997f4adaf3c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:25.170354 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e704008-5a8b-411d-970e-997f4adaf3c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:25.171078 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e704008-5a8b-411d-970e-997f4adaf3c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:25.172333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e704008-5a8b-411d-970e-997f4adaf3c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:25.173025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e704008-5a8b-411d-970e-997f4adaf3c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:25.234333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3e704008-5a8b-411d-970e-997f4adaf3c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:25.243048 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3e704008-5a8b-411d-970e-997f4adaf3c2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089367 Dec 15 16:48:25.243631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1470/2736] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:25 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:26.261665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a10b6de8-25aa-4828-9cad-4592311d9ce4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:26.262413 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a10b6de8-25aa-4828-9cad-4592311d9ce4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:26.270449 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a10b6de8-25aa-4828-9cad-4592311d9ce4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:26.270965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a10b6de8-25aa-4828-9cad-4592311d9ce4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:26.271906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a10b6de8-25aa-4828-9cad-4592311d9ce4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:26.272412 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a10b6de8-25aa-4828-9cad-4592311d9ce4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:26.333042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a10b6de8-25aa-4828-9cad-4592311d9ce4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:26.341194 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a10b6de8-25aa-4828-9cad-4592311d9ce4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083907 Dec 15 16:48:26.341782 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1267/2737] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:27.362668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-84924424-b164-45df-8ccd-9dd7b419513f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:27.363757 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-84924424-b164-45df-8ccd-9dd7b419513f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:27.370538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-84924424-b164-45df-8ccd-9dd7b419513f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:27.370988 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-84924424-b164-45df-8ccd-9dd7b419513f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:27.371766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-84924424-b164-45df-8ccd-9dd7b419513f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:27.372198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-84924424-b164-45df-8ccd-9dd7b419513f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:27.437183 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-84924424-b164-45df-8ccd-9dd7b419513f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:27.446361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-84924424-b164-45df-8ccd-9dd7b419513f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089938 Dec 15 16:48:27.446943 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1471/2738] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:27 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:28.467598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1e50e317-3912-4854-a608-10ff084be3fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:28.468509 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1e50e317-3912-4854-a608-10ff084be3fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:28.479597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e50e317-3912-4854-a608-10ff084be3fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:28.480335 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e50e317-3912-4854-a608-10ff084be3fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:28.481735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e50e317-3912-4854-a608-10ff084be3fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:28.482417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1e50e317-3912-4854-a608-10ff084be3fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:28.547553 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1e50e317-3912-4854-a608-10ff084be3fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:28.561282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1e50e317-3912-4854-a608-10ff084be3fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099703 Dec 15 16:48:28.562108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1268/2739] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:29.584589 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-79fde63a-fff3-463c-aef8-99f67d8809b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:29.585525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-79fde63a-fff3-463c-aef8-99f67d8809b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:29.596526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-79fde63a-fff3-463c-aef8-99f67d8809b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:29.597290 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-79fde63a-fff3-463c-aef8-99f67d8809b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:29.598443 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-79fde63a-fff3-463c-aef8-99f67d8809b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:29.598841 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-79fde63a-fff3-463c-aef8-99f67d8809b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:29.658979 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-79fde63a-fff3-463c-aef8-99f67d8809b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:29.667006 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-79fde63a-fff3-463c-aef8-99f67d8809b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088623 Dec 15 16:48:29.667577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1472/2740] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:30.687373 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7120a543-e967-4fb2-a384-3036f6bd9682 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:30.688303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7120a543-e967-4fb2-a384-3036f6bd9682 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:30.697838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7120a543-e967-4fb2-a384-3036f6bd9682 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:30.698511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7120a543-e967-4fb2-a384-3036f6bd9682 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:30.699746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7120a543-e967-4fb2-a384-3036f6bd9682 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:30.700425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7120a543-e967-4fb2-a384-3036f6bd9682 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:30.766320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7120a543-e967-4fb2-a384-3036f6bd9682 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:30.777933 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7120a543-e967-4fb2-a384-3036f6bd9682 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096009 Dec 15 16:48:30.778705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1269/2741] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:31.801949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-65740310-dc09-4da1-8a78-2c673fc49b75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:31.802918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-65740310-dc09-4da1-8a78-2c673fc49b75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:31.813612 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65740310-dc09-4da1-8a78-2c673fc49b75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:31.814342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65740310-dc09-4da1-8a78-2c673fc49b75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:31.815615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65740310-dc09-4da1-8a78-2c673fc49b75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:31.816483 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-65740310-dc09-4da1-8a78-2c673fc49b75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:31.879620 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-65740310-dc09-4da1-8a78-2c673fc49b75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:31.891431 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-65740310-dc09-4da1-8a78-2c673fc49b75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095700 Dec 15 16:48:31.892257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1473/2742] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:32.914225 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-61f147b9-a4b6-4c15-9a07-17815ab03377 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:32.915220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-61f147b9-a4b6-4c15-9a07-17815ab03377 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:32.926221 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61f147b9-a4b6-4c15-9a07-17815ab03377 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:32.926676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61f147b9-a4b6-4c15-9a07-17815ab03377 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:32.927475 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61f147b9-a4b6-4c15-9a07-17815ab03377 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:32.927911 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-61f147b9-a4b6-4c15-9a07-17815ab03377 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:32.987812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-61f147b9-a4b6-4c15-9a07-17815ab03377 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:32.996161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-61f147b9-a4b6-4c15-9a07-17815ab03377 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088755 Dec 15 16:48:32.996762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1270/2743] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:34.016663 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-06218244-8ea1-4a47-8e90-2a9c76edf788 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:34.017507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-06218244-8ea1-4a47-8e90-2a9c76edf788 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:34.026297 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06218244-8ea1-4a47-8e90-2a9c76edf788 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:34.026926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06218244-8ea1-4a47-8e90-2a9c76edf788 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:34.028021 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06218244-8ea1-4a47-8e90-2a9c76edf788 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:34.028684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-06218244-8ea1-4a47-8e90-2a9c76edf788 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:34.096349 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-06218244-8ea1-4a47-8e90-2a9c76edf788 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:34.104566 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-06218244-8ea1-4a47-8e90-2a9c76edf788 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093622 Dec 15 16:48:34.105172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1474/2744] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:35.123450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-43573b2a-95d6-44bf-a07a-fc295e252981 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:35.123450 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-43573b2a-95d6-44bf-a07a-fc295e252981 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:35.130296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-43573b2a-95d6-44bf-a07a-fc295e252981 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:35.130745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-43573b2a-95d6-44bf-a07a-fc295e252981 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:35.131533 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-43573b2a-95d6-44bf-a07a-fc295e252981 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:35.131965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-43573b2a-95d6-44bf-a07a-fc295e252981 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:35.201579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-43573b2a-95d6-44bf-a07a-fc295e252981 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:35.211778 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-43573b2a-95d6-44bf-a07a-fc295e252981 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092833 Dec 15 16:48:35.212363 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1271/2745] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:36.233251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e97ba342-c4e5-46f0-890f-d257a6c8691f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:36.234179 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e97ba342-c4e5-46f0-890f-d257a6c8691f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:36.242511 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e97ba342-c4e5-46f0-890f-d257a6c8691f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:36.242951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e97ba342-c4e5-46f0-890f-d257a6c8691f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:36.243727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e97ba342-c4e5-46f0-890f-d257a6c8691f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:36.244150 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e97ba342-c4e5-46f0-890f-d257a6c8691f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:36.308406 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e97ba342-c4e5-46f0-890f-d257a6c8691f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:36.317649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e97ba342-c4e5-46f0-890f-d257a6c8691f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090023 Dec 15 16:48:36.318223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1475/2746] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:37.337695 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ccbac3c5-79c8-4980-81b5-7d698ea57f9d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:37.338411 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ccbac3c5-79c8-4980-81b5-7d698ea57f9d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:37.347307 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccbac3c5-79c8-4980-81b5-7d698ea57f9d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:37.347874 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccbac3c5-79c8-4980-81b5-7d698ea57f9d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:37.348823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccbac3c5-79c8-4980-81b5-7d698ea57f9d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:37.349467 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ccbac3c5-79c8-4980-81b5-7d698ea57f9d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:37.415682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ccbac3c5-79c8-4980-81b5-7d698ea57f9d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:37.424040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ccbac3c5-79c8-4980-81b5-7d698ea57f9d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092163 Dec 15 16:48:37.424635 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1272/2747] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:38.445522 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0986b29a-f213-4172-817a-7fee350c1797 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:38.446453 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0986b29a-f213-4172-817a-7fee350c1797 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:38.457205 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0986b29a-f213-4172-817a-7fee350c1797 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:38.457952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0986b29a-f213-4172-817a-7fee350c1797 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:38.459501 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0986b29a-f213-4172-817a-7fee350c1797 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:38.460216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0986b29a-f213-4172-817a-7fee350c1797 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:38.525635 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0986b29a-f213-4172-817a-7fee350c1797 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:38.533713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0986b29a-f213-4172-817a-7fee350c1797 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094646 Dec 15 16:48:38.534279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1476/2748] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:39.553231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-694abe49-1863-4b5f-ac05-26b9892b9f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:39.553836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-694abe49-1863-4b5f-ac05-26b9892b9f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:39.560459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-694abe49-1863-4b5f-ac05-26b9892b9f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:39.560922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-694abe49-1863-4b5f-ac05-26b9892b9f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:39.561702 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-694abe49-1863-4b5f-ac05-26b9892b9f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:39.562138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-694abe49-1863-4b5f-ac05-26b9892b9f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:39.628346 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-694abe49-1863-4b5f-ac05-26b9892b9f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:39.636746 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-694abe49-1863-4b5f-ac05-26b9892b9f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089113 Dec 15 16:48:39.637309 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1273/2749] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:39 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:40.654802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cb77081d-7851-4c75-90af-d534fb8e3f48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:40.655467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cb77081d-7851-4c75-90af-d534fb8e3f48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:40.662162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb77081d-7851-4c75-90af-d534fb8e3f48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:40.662606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb77081d-7851-4c75-90af-d534fb8e3f48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:40.663368 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb77081d-7851-4c75-90af-d534fb8e3f48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:40.663794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cb77081d-7851-4c75-90af-d534fb8e3f48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:40.738821 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cb77081d-7851-4c75-90af-d534fb8e3f48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:40.747686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cb77081d-7851-4c75-90af-d534fb8e3f48 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096929 Dec 15 16:48:40.748247 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1477/2750] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:41.770057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d3a70687-b76e-4018-863c-874ef135ac14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:41.771625 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d3a70687-b76e-4018-863c-874ef135ac14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:41.782514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3a70687-b76e-4018-863c-874ef135ac14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:41.783264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3a70687-b76e-4018-863c-874ef135ac14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:41.784627 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3a70687-b76e-4018-863c-874ef135ac14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:41.785530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d3a70687-b76e-4018-863c-874ef135ac14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:41.857855 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d3a70687-b76e-4018-863c-874ef135ac14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:41.870014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d3a70687-b76e-4018-863c-874ef135ac14 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.106834 Dec 15 16:48:41.870767 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1274/2751] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:42.891437 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e9ba9e10-82b1-48ba-8d51-4b2d197a2933 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:42.892423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e9ba9e10-82b1-48ba-8d51-4b2d197a2933 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:42.900113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9ba9e10-82b1-48ba-8d51-4b2d197a2933 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:42.900588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9ba9e10-82b1-48ba-8d51-4b2d197a2933 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:42.901371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9ba9e10-82b1-48ba-8d51-4b2d197a2933 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:42.901794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9ba9e10-82b1-48ba-8d51-4b2d197a2933 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:42.970787 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e9ba9e10-82b1-48ba-8d51-4b2d197a2933 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:42.979424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e9ba9e10-82b1-48ba-8d51-4b2d197a2933 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094035 Dec 15 16:48:42.979995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1478/2752] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:44.001096 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6acfd587-29f3-4a04-a97c-18611671017c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:44.002123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6acfd587-29f3-4a04-a97c-18611671017c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:44.009572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6acfd587-29f3-4a04-a97c-18611671017c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:44.010040 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6acfd587-29f3-4a04-a97c-18611671017c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:44.010822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6acfd587-29f3-4a04-a97c-18611671017c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:44.011251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6acfd587-29f3-4a04-a97c-18611671017c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:44.073227 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-6acfd587-29f3-4a04-a97c-18611671017c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:44.081309 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6acfd587-29f3-4a04-a97c-18611671017c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086468 Dec 15 16:48:44.081888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1275/2753] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:45.102732 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6f04d194-516c-4a8d-a808-0e29207b509f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:45.103786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6f04d194-516c-4a8d-a808-0e29207b509f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:45.114202 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f04d194-516c-4a8d-a808-0e29207b509f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:45.114670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f04d194-516c-4a8d-a808-0e29207b509f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:45.115489 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f04d194-516c-4a8d-a808-0e29207b509f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:45.115928 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f04d194-516c-4a8d-a808-0e29207b509f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:45.175475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6f04d194-516c-4a8d-a808-0e29207b509f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:45.187939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6f04d194-516c-4a8d-a808-0e29207b509f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091407 Dec 15 16:48:45.188535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1479/2754] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:46.211011 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-33e46301-8f14-44fe-b2b6-a4db39585de3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:46.212048 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-33e46301-8f14-44fe-b2b6-a4db39585de3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:46.223167 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33e46301-8f14-44fe-b2b6-a4db39585de3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:46.223628 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33e46301-8f14-44fe-b2b6-a4db39585de3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:46.224465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33e46301-8f14-44fe-b2b6-a4db39585de3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:46.224989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-33e46301-8f14-44fe-b2b6-a4db39585de3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:46.292454 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-33e46301-8f14-44fe-b2b6-a4db39585de3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:46.300795 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-33e46301-8f14-44fe-b2b6-a4db39585de3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096008 Dec 15 16:48:46.301365 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1276/2755] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:47.321974 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-49e638b2-42f3-4613-9181-a583af629d70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:47.323071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-49e638b2-42f3-4613-9181-a583af629d70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:47.333146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-49e638b2-42f3-4613-9181-a583af629d70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:47.333582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-49e638b2-42f3-4613-9181-a583af629d70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:47.334355 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-49e638b2-42f3-4613-9181-a583af629d70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:47.334782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-49e638b2-42f3-4613-9181-a583af629d70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:47.397714 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-49e638b2-42f3-4613-9181-a583af629d70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:47.407257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-49e638b2-42f3-4613-9181-a583af629d70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091620 Dec 15 16:48:47.408275 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1480/2756] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:47 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:48.432603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-810c777c-36e1-46b3-95bf-6b73b5f79893 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:48.433579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-810c777c-36e1-46b3-95bf-6b73b5f79893 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:48.443433 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-810c777c-36e1-46b3-95bf-6b73b5f79893 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:48.443886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-810c777c-36e1-46b3-95bf-6b73b5f79893 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:48.444716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-810c777c-36e1-46b3-95bf-6b73b5f79893 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:48.445152 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-810c777c-36e1-46b3-95bf-6b73b5f79893 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:48.515289 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-810c777c-36e1-46b3-95bf-6b73b5f79893 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:48.523418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-810c777c-36e1-46b3-95bf-6b73b5f79893 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097524 Dec 15 16:48:48.523989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1277/2757] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:49.541908 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-69394d26-1a0a-483b-bf92-cd4089d0886a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:49.542728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-69394d26-1a0a-483b-bf92-cd4089d0886a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:49.551393 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69394d26-1a0a-483b-bf92-cd4089d0886a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:49.552048 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69394d26-1a0a-483b-bf92-cd4089d0886a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:49.552886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69394d26-1a0a-483b-bf92-cd4089d0886a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:49.553307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-69394d26-1a0a-483b-bf92-cd4089d0886a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:49.615037 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-69394d26-1a0a-483b-bf92-cd4089d0886a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:49.623087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-69394d26-1a0a-483b-bf92-cd4089d0886a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086269 Dec 15 16:48:49.623654 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1481/2758] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:50.640138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4a2a9c1e-6230-4970-b262-1b708ad9f99d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:50.640774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4a2a9c1e-6230-4970-b262-1b708ad9f99d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:50.647507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a2a9c1e-6230-4970-b262-1b708ad9f99d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:50.647946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a2a9c1e-6230-4970-b262-1b708ad9f99d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:50.648764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a2a9c1e-6230-4970-b262-1b708ad9f99d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:50.649189 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4a2a9c1e-6230-4970-b262-1b708ad9f99d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:50.727002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4a2a9c1e-6230-4970-b262-1b708ad9f99d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:50.736210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4a2a9c1e-6230-4970-b262-1b708ad9f99d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.100017 Dec 15 16:48:50.737208 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1278/2759] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:51.762673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9bcd1322-7587-4694-9654-bc9497ad7176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:51.763636 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9bcd1322-7587-4694-9654-bc9497ad7176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:51.774118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9bcd1322-7587-4694-9654-bc9497ad7176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:51.774569 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9bcd1322-7587-4694-9654-bc9497ad7176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:51.775346 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9bcd1322-7587-4694-9654-bc9497ad7176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:51.775783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9bcd1322-7587-4694-9654-bc9497ad7176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:51.838060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9bcd1322-7587-4694-9654-bc9497ad7176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:51.846708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9bcd1322-7587-4694-9654-bc9497ad7176 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090228 Dec 15 16:48:51.847283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1482/2760] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:52.867252 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2eaeb081-1f0b-4e52-a95e-745acf025912 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:52.868050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2eaeb081-1f0b-4e52-a95e-745acf025912 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:52.876790 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2eaeb081-1f0b-4e52-a95e-745acf025912 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:52.877391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2eaeb081-1f0b-4e52-a95e-745acf025912 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:52.878436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2eaeb081-1f0b-4e52-a95e-745acf025912 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:52.879020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2eaeb081-1f0b-4e52-a95e-745acf025912 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:52.952769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2eaeb081-1f0b-4e52-a95e-745acf025912 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:52.961725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2eaeb081-1f0b-4e52-a95e-745acf025912 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.100497 Dec 15 16:48:52.962320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1279/2761] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:53.982502 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b0419755-0a84-4893-8c4f-2600cf3c0269 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:53.983146 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b0419755-0a84-4893-8c4f-2600cf3c0269 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:53.991515 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b0419755-0a84-4893-8c4f-2600cf3c0269 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:53.991957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b0419755-0a84-4893-8c4f-2600cf3c0269 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:53.992763 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b0419755-0a84-4893-8c4f-2600cf3c0269 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:53.993193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b0419755-0a84-4893-8c4f-2600cf3c0269 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:54.055813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b0419755-0a84-4893-8c4f-2600cf3c0269 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:54.064526 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b0419755-0a84-4893-8c4f-2600cf3c0269 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087979 Dec 15 16:48:54.065084 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1483/2762] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:53 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:55.085088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-34eba0b4-9ff7-470c-a744-8022bed62e34 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:55.085838 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-34eba0b4-9ff7-470c-a744-8022bed62e34 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:55.093665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-34eba0b4-9ff7-470c-a744-8022bed62e34 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:55.094182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-34eba0b4-9ff7-470c-a744-8022bed62e34 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:55.095051 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-34eba0b4-9ff7-470c-a744-8022bed62e34 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:55.095546 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-34eba0b4-9ff7-470c-a744-8022bed62e34 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:55.157912 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-34eba0b4-9ff7-470c-a744-8022bed62e34 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:55.166569 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-34eba0b4-9ff7-470c-a744-8022bed62e34 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087029 Dec 15 16:48:55.167147 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1280/2763] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:56.187921 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cc685d27-832f-4762-935f-ebce3a7f4f98 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:56.188930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cc685d27-832f-4762-935f-ebce3a7f4f98 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:56.197118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cc685d27-832f-4762-935f-ebce3a7f4f98 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:56.197567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cc685d27-832f-4762-935f-ebce3a7f4f98 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:56.198341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cc685d27-832f-4762-935f-ebce3a7f4f98 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:56.198771 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cc685d27-832f-4762-935f-ebce3a7f4f98 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:56.262844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cc685d27-832f-4762-935f-ebce3a7f4f98 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:56.270816 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cc685d27-832f-4762-935f-ebce3a7f4f98 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089073 Dec 15 16:48:56.271659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1484/2764] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:57.293301 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2287b573-7e31-48a2-aada-99b69ba26b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:57.293976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2287b573-7e31-48a2-aada-99b69ba26b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:57.301448 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2287b573-7e31-48a2-aada-99b69ba26b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:57.301950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2287b573-7e31-48a2-aada-99b69ba26b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:57.303172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2287b573-7e31-48a2-aada-99b69ba26b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:57.303590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2287b573-7e31-48a2-aada-99b69ba26b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:57.370089 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2287b573-7e31-48a2-aada-99b69ba26b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:57.384841 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2287b573-7e31-48a2-aada-99b69ba26b2b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095685 Dec 15 16:48:57.385327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1281/2765] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:58.411572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e247a7fc-2cbd-4b7a-8ad5-c0cf78e1f518 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:58.412726 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e247a7fc-2cbd-4b7a-8ad5-c0cf78e1f518 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:58.418914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e247a7fc-2cbd-4b7a-8ad5-c0cf78e1f518 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:58.419359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e247a7fc-2cbd-4b7a-8ad5-c0cf78e1f518 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:58.420127 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e247a7fc-2cbd-4b7a-8ad5-c0cf78e1f518 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:58.420598 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e247a7fc-2cbd-4b7a-8ad5-c0cf78e1f518 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:58.483305 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e247a7fc-2cbd-4b7a-8ad5-c0cf78e1f518 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:58.492304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e247a7fc-2cbd-4b7a-8ad5-c0cf78e1f518 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086919 Dec 15 16:48:58.492978 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1485/2766] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:48:59.513003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-913685fe-bc40-4b5f-8a51-a45acd3ed7d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:48:59.513581 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-913685fe-bc40-4b5f-8a51-a45acd3ed7d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:48:59.522444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-913685fe-bc40-4b5f-8a51-a45acd3ed7d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:59.522899 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-913685fe-bc40-4b5f-8a51-a45acd3ed7d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:59.523692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-913685fe-bc40-4b5f-8a51-a45acd3ed7d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:48:59.524127 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-913685fe-bc40-4b5f-8a51-a45acd3ed7d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:48:59.594460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-913685fe-bc40-4b5f-8a51-a45acd3ed7d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:48:59.602690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-913685fe-bc40-4b5f-8a51-a45acd3ed7d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095772 Dec 15 16:48:59.603265 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1282/2767] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:48:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:00.623596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-628e99fc-0dfc-4b4e-b0f4-f0470580c454 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:00.624761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-628e99fc-0dfc-4b4e-b0f4-f0470580c454 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:00.634814 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-628e99fc-0dfc-4b4e-b0f4-f0470580c454 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:00.635400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-628e99fc-0dfc-4b4e-b0f4-f0470580c454 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:00.636399 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-628e99fc-0dfc-4b4e-b0f4-f0470580c454 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:00.636873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-628e99fc-0dfc-4b4e-b0f4-f0470580c454 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:00.699317 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-628e99fc-0dfc-4b4e-b0f4-f0470580c454 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:00.708076 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-628e99fc-0dfc-4b4e-b0f4-f0470580c454 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090621 Dec 15 16:49:00.708768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1486/2768] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:01.730112 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d7a4f7f6-3756-4601-8094-69bbf3c11058 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:01.731110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d7a4f7f6-3756-4601-8094-69bbf3c11058 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:01.740825 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7a4f7f6-3756-4601-8094-69bbf3c11058 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:01.741285 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7a4f7f6-3756-4601-8094-69bbf3c11058 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:01.742073 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7a4f7f6-3756-4601-8094-69bbf3c11058 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:01.742524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7a4f7f6-3756-4601-8094-69bbf3c11058 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:01.811222 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d7a4f7f6-3756-4601-8094-69bbf3c11058 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:01.819775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d7a4f7f6-3756-4601-8094-69bbf3c11058 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096233 Dec 15 16:49:01.820375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1283/2769] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:02.841473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a426b75a-fe1b-4993-9d42-0d871c1707e0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:02.842432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a426b75a-fe1b-4993-9d42-0d871c1707e0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:02.852069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a426b75a-fe1b-4993-9d42-0d871c1707e0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:02.852545 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a426b75a-fe1b-4993-9d42-0d871c1707e0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:02.853319 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a426b75a-fe1b-4993-9d42-0d871c1707e0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:02.853756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a426b75a-fe1b-4993-9d42-0d871c1707e0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:02.913512 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a426b75a-fe1b-4993-9d42-0d871c1707e0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:02.922182 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a426b75a-fe1b-4993-9d42-0d871c1707e0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086975 Dec 15 16:49:02.922749 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1487/2770] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:03.944886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c53a5b6c-1134-4218-8a2e-bb19d846a510 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:03.945597 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c53a5b6c-1134-4218-8a2e-bb19d846a510 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:03.952498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c53a5b6c-1134-4218-8a2e-bb19d846a510 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:03.952980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c53a5b6c-1134-4218-8a2e-bb19d846a510 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:03.953804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c53a5b6c-1134-4218-8a2e-bb19d846a510 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:03.954263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c53a5b6c-1134-4218-8a2e-bb19d846a510 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:04.015764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c53a5b6c-1134-4218-8a2e-bb19d846a510 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:04.024343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c53a5b6c-1134-4218-8a2e-bb19d846a510 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083897 Dec 15 16:49:04.024968 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1284/2771] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:05.043209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-edb22a8d-8179-4360-8e27-82c0cc5f35ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:05.043834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-edb22a8d-8179-4360-8e27-82c0cc5f35ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:05.050548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-edb22a8d-8179-4360-8e27-82c0cc5f35ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:05.050997 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-edb22a8d-8179-4360-8e27-82c0cc5f35ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:05.051777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-edb22a8d-8179-4360-8e27-82c0cc5f35ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:05.052209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-edb22a8d-8179-4360-8e27-82c0cc5f35ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:05.116820 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-edb22a8d-8179-4360-8e27-82c0cc5f35ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:05.127213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-edb22a8d-8179-4360-8e27-82c0cc5f35ac tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087471 Dec 15 16:49:05.128065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1488/2772] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:06.147952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-70be09e6-4e8e-49c4-bcb3-85be60af96a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:06.148583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-70be09e6-4e8e-49c4-bcb3-85be60af96a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:06.155329 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70be09e6-4e8e-49c4-bcb3-85be60af96a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:06.155770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70be09e6-4e8e-49c4-bcb3-85be60af96a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:06.156614 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70be09e6-4e8e-49c4-bcb3-85be60af96a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:06.157062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-70be09e6-4e8e-49c4-bcb3-85be60af96a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:06.225282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-70be09e6-4e8e-49c4-bcb3-85be60af96a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:06.233674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-70be09e6-4e8e-49c4-bcb3-85be60af96a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091718 Dec 15 16:49:06.234246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1285/2773] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:07.253439 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7a26decb-df8b-4b98-9058-a13c7da51603 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:07.254242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7a26decb-df8b-4b98-9058-a13c7da51603 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:07.261809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a26decb-df8b-4b98-9058-a13c7da51603 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:07.262258 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a26decb-df8b-4b98-9058-a13c7da51603 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:07.263057 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a26decb-df8b-4b98-9058-a13c7da51603 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:07.263476 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7a26decb-df8b-4b98-9058-a13c7da51603 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:07.334895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7a26decb-df8b-4b98-9058-a13c7da51603 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:07.348251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7a26decb-df8b-4b98-9058-a13c7da51603 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099802 Dec 15 16:49:07.349152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1489/2774] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:08.375255 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-13b7e3bf-dfb7-4234-9e4b-9e4863aa9afa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:08.376187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-13b7e3bf-dfb7-4234-9e4b-9e4863aa9afa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:08.387554 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-13b7e3bf-dfb7-4234-9e4b-9e4863aa9afa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:08.388303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-13b7e3bf-dfb7-4234-9e4b-9e4863aa9afa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:08.389651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-13b7e3bf-dfb7-4234-9e4b-9e4863aa9afa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:08.390373 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-13b7e3bf-dfb7-4234-9e4b-9e4863aa9afa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:08.456145 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-13b7e3bf-dfb7-4234-9e4b-9e4863aa9afa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:08.464770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-13b7e3bf-dfb7-4234-9e4b-9e4863aa9afa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096073 Dec 15 16:49:08.465383 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1286/2775] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:09.486599 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3266564f-9ca2-4f25-87b6-7e7605be916e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:09.487537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3266564f-9ca2-4f25-87b6-7e7605be916e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:09.498266 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3266564f-9ca2-4f25-87b6-7e7605be916e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:09.499010 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3266564f-9ca2-4f25-87b6-7e7605be916e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:09.500286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3266564f-9ca2-4f25-87b6-7e7605be916e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:09.501051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3266564f-9ca2-4f25-87b6-7e7605be916e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:09.564209 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3266564f-9ca2-4f25-87b6-7e7605be916e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:09.572407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3266564f-9ca2-4f25-87b6-7e7605be916e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092164 Dec 15 16:49:09.573005 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1490/2776] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:10.593883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3d697507-7e63-4516-b9ce-ed5579737e60 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:10.594816 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3d697507-7e63-4516-b9ce-ed5579737e60 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:10.605590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d697507-7e63-4516-b9ce-ed5579737e60 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:10.606331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d697507-7e63-4516-b9ce-ed5579737e60 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:10.607608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d697507-7e63-4516-b9ce-ed5579737e60 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:10.608320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3d697507-7e63-4516-b9ce-ed5579737e60 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:10.674434 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3d697507-7e63-4516-b9ce-ed5579737e60 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:10.682625 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3d697507-7e63-4516-b9ce-ed5579737e60 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095320 Dec 15 16:49:10.683205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1287/2777] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:11.703643 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e957fcb0-9779-4373-9a04-0d326fd5abb6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:11.704633 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e957fcb0-9779-4373-9a04-0d326fd5abb6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:11.715766 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e957fcb0-9779-4373-9a04-0d326fd5abb6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:11.716570 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e957fcb0-9779-4373-9a04-0d326fd5abb6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:11.718524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e957fcb0-9779-4373-9a04-0d326fd5abb6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:11.719279 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e957fcb0-9779-4373-9a04-0d326fd5abb6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:11.781883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e957fcb0-9779-4373-9a04-0d326fd5abb6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:11.790154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e957fcb0-9779-4373-9a04-0d326fd5abb6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092543 Dec 15 16:49:11.790734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1491/2778] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:12.811161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-558cd56a-b714-4353-be15-85ef7c65481e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:12.812188 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-558cd56a-b714-4353-be15-85ef7c65481e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:12.821031 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-558cd56a-b714-4353-be15-85ef7c65481e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:12.821600 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-558cd56a-b714-4353-be15-85ef7c65481e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:12.822578 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-558cd56a-b714-4353-be15-85ef7c65481e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:12.823132 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-558cd56a-b714-4353-be15-85ef7c65481e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:12.893115 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-558cd56a-b714-4353-be15-85ef7c65481e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:12.901857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-558cd56a-b714-4353-be15-85ef7c65481e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096524 Dec 15 16:49:12.902594 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1288/2779] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:13.924900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-99fa72c9-0f43-46cc-9898-0b8f391b9c01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:13.925550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-99fa72c9-0f43-46cc-9898-0b8f391b9c01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:13.932407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99fa72c9-0f43-46cc-9898-0b8f391b9c01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:13.932879 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99fa72c9-0f43-46cc-9898-0b8f391b9c01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:13.933650 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99fa72c9-0f43-46cc-9898-0b8f391b9c01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:13.934081 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-99fa72c9-0f43-46cc-9898-0b8f391b9c01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:14.005905 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-99fa72c9-0f43-46cc-9898-0b8f391b9c01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:14.014267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-99fa72c9-0f43-46cc-9898-0b8f391b9c01 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095643 Dec 15 16:49:14.014806 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1492/2780] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:13 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:15.031884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c07895fe-e08a-4ff0-97cd-3eddfda75aed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:15.032536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c07895fe-e08a-4ff0-97cd-3eddfda75aed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:15.039837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c07895fe-e08a-4ff0-97cd-3eddfda75aed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:15.040286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c07895fe-e08a-4ff0-97cd-3eddfda75aed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:15.041109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c07895fe-e08a-4ff0-97cd-3eddfda75aed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:15.041544 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c07895fe-e08a-4ff0-97cd-3eddfda75aed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:15.102242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c07895fe-e08a-4ff0-97cd-3eddfda75aed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:15.110862 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c07895fe-e08a-4ff0-97cd-3eddfda75aed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.082698 Dec 15 16:49:15.111425 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1289/2781] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:16.130968 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-cdb3bee4-d623-4501-a5d1-f60b07d652d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:16.131583 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-cdb3bee4-d623-4501-a5d1-f60b07d652d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:16.138433 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cdb3bee4-d623-4501-a5d1-f60b07d652d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:16.138887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cdb3bee4-d623-4501-a5d1-f60b07d652d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:16.139678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cdb3bee4-d623-4501-a5d1-f60b07d652d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:16.140108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-cdb3bee4-d623-4501-a5d1-f60b07d652d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:16.200676 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-cdb3bee4-d623-4501-a5d1-f60b07d652d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:16.209380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-cdb3bee4-d623-4501-a5d1-f60b07d652d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083175 Dec 15 16:49:16.209950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1493/2782] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:16 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:17.230579 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3c446876-7520-4b1c-9fa8-2c2ee92ec182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:17.231506 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3c446876-7520-4b1c-9fa8-2c2ee92ec182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:17.240716 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c446876-7520-4b1c-9fa8-2c2ee92ec182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:17.241168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c446876-7520-4b1c-9fa8-2c2ee92ec182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:17.241955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c446876-7520-4b1c-9fa8-2c2ee92ec182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:17.242387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c446876-7520-4b1c-9fa8-2c2ee92ec182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:17.303066 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3c446876-7520-4b1c-9fa8-2c2ee92ec182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:17.311035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3c446876-7520-4b1c-9fa8-2c2ee92ec182 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086493 Dec 15 16:49:17.311598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1290/2783] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:18.329929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a3771f0b-27ca-444b-91ed-c6d526f8e942 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:18.330531 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a3771f0b-27ca-444b-91ed-c6d526f8e942 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:18.339322 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3771f0b-27ca-444b-91ed-c6d526f8e942 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:18.339764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3771f0b-27ca-444b-91ed-c6d526f8e942 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:18.340859 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3771f0b-27ca-444b-91ed-c6d526f8e942 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:18.341283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a3771f0b-27ca-444b-91ed-c6d526f8e942 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:18.414082 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a3771f0b-27ca-444b-91ed-c6d526f8e942 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:18.422211 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a3771f0b-27ca-444b-91ed-c6d526f8e942 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097309 Dec 15 16:49:18.422782 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1494/2784] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:19.443967 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b7afd026-59a7-4792-a8f3-49a94e6421c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:19.445056 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b7afd026-59a7-4792-a8f3-49a94e6421c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:19.455924 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7afd026-59a7-4792-a8f3-49a94e6421c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:19.456410 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7afd026-59a7-4792-a8f3-49a94e6421c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:19.457263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7afd026-59a7-4792-a8f3-49a94e6421c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:19.457762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b7afd026-59a7-4792-a8f3-49a94e6421c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:19.517488 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b7afd026-59a7-4792-a8f3-49a94e6421c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:19.525867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b7afd026-59a7-4792-a8f3-49a94e6421c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088678 Dec 15 16:49:19.526442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1291/2785] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:19 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:20.543163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-72f80882-ff66-4030-995c-e7f9cd32b4fc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:20.543768 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-72f80882-ff66-4030-995c-e7f9cd32b4fc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:20.551138 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72f80882-ff66-4030-995c-e7f9cd32b4fc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:20.551582 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72f80882-ff66-4030-995c-e7f9cd32b4fc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:20.552364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72f80882-ff66-4030-995c-e7f9cd32b4fc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:20.552860 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-72f80882-ff66-4030-995c-e7f9cd32b4fc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:20.617991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-72f80882-ff66-4030-995c-e7f9cd32b4fc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:20.627092 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-72f80882-ff66-4030-995c-e7f9cd32b4fc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087440 Dec 15 16:49:20.634796 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1495/2786] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:20 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:21.649572 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-edb13215-b15e-4759-a4a4-50082986715c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:21.650583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-edb13215-b15e-4759-a4a4-50082986715c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:21.661950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edb13215-b15e-4759-a4a4-50082986715c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:21.662685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edb13215-b15e-4759-a4a4-50082986715c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:21.663949 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edb13215-b15e-4759-a4a4-50082986715c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:21.664712 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-edb13215-b15e-4759-a4a4-50082986715c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:21.730793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-edb13215-b15e-4759-a4a4-50082986715c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:21.739355 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-edb13215-b15e-4759-a4a4-50082986715c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096546 Dec 15 16:49:21.739906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1292/2787] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:22.765701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f80f4918-7252-44b0-a847-b93de9bea5f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:22.766665 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f80f4918-7252-44b0-a847-b93de9bea5f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:22.777581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f80f4918-7252-44b0-a847-b93de9bea5f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:22.778336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f80f4918-7252-44b0-a847-b93de9bea5f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:22.779634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f80f4918-7252-44b0-a847-b93de9bea5f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:22.780363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f80f4918-7252-44b0-a847-b93de9bea5f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:22.854142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f80f4918-7252-44b0-a847-b93de9bea5f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:22.862685 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f80f4918-7252-44b0-a847-b93de9bea5f8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.103252 Dec 15 16:49:22.863229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1496/2788] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:23.889215 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-78c5a2c6-471f-47c2-9f8d-1eefa85f20d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:23.890169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-78c5a2c6-471f-47c2-9f8d-1eefa85f20d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:23.898514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78c5a2c6-471f-47c2-9f8d-1eefa85f20d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:23.898969 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78c5a2c6-471f-47c2-9f8d-1eefa85f20d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:23.899756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78c5a2c6-471f-47c2-9f8d-1eefa85f20d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:23.900202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-78c5a2c6-471f-47c2-9f8d-1eefa85f20d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:23.962763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-78c5a2c6-471f-47c2-9f8d-1eefa85f20d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:23.972074 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-78c5a2c6-471f-47c2-9f8d-1eefa85f20d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089121 Dec 15 16:49:23.972671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1293/2789] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:23 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:24.998041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9444fa44-678f-42b1-b375-ace9cd5db881 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:24.999722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9444fa44-678f-42b1-b375-ace9cd5db881 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:25.008378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9444fa44-678f-42b1-b375-ace9cd5db881 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:25.008847 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9444fa44-678f-42b1-b375-ace9cd5db881 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:25.009634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9444fa44-678f-42b1-b375-ace9cd5db881 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:25.010062 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9444fa44-678f-42b1-b375-ace9cd5db881 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:25.069118 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9444fa44-678f-42b1-b375-ace9cd5db881 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:25.077124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9444fa44-678f-42b1-b375-ace9cd5db881 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085308 Dec 15 16:49:25.077729 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1497/2790] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:24 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:26.099250 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a97384b1-271d-490f-a232-c32144c36694 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:26.100258 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a97384b1-271d-490f-a232-c32144c36694 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:26.111053 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a97384b1-271d-490f-a232-c32144c36694 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:26.111802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a97384b1-271d-490f-a232-c32144c36694 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:26.113169 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a97384b1-271d-490f-a232-c32144c36694 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:26.113900 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a97384b1-271d-490f-a232-c32144c36694 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:26.173556 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a97384b1-271d-490f-a232-c32144c36694 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:26.181633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a97384b1-271d-490f-a232-c32144c36694 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089440 Dec 15 16:49:26.182207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1294/2791] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:27.198983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2ab0268c-1578-4a2d-92d4-297e8e030bd8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:27.199594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2ab0268c-1578-4a2d-92d4-297e8e030bd8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:27.206151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ab0268c-1578-4a2d-92d4-297e8e030bd8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:27.206596 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ab0268c-1578-4a2d-92d4-297e8e030bd8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:27.207374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ab0268c-1578-4a2d-92d4-297e8e030bd8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:27.207808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2ab0268c-1578-4a2d-92d4-297e8e030bd8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:27.271269 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2ab0268c-1578-4a2d-92d4-297e8e030bd8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:27.279404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2ab0268c-1578-4a2d-92d4-297e8e030bd8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084119 Dec 15 16:49:27.279976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1498/2792] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:27 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:28.297149 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d7ff0ace-b913-4cec-a514-e53513e15226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:28.297770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d7ff0ace-b913-4cec-a514-e53513e15226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:28.304787 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7ff0ace-b913-4cec-a514-e53513e15226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:28.305236 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7ff0ace-b913-4cec-a514-e53513e15226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:28.306028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7ff0ace-b913-4cec-a514-e53513e15226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:28.306464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d7ff0ace-b913-4cec-a514-e53513e15226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:28.367951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d7ff0ace-b913-4cec-a514-e53513e15226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:28.376545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d7ff0ace-b913-4cec-a514-e53513e15226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083236 Dec 15 16:49:28.377081 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1295/2793] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:29.397967 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-68e8a10b-2663-4fcd-ad54-db0113ad8e59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:29.398853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-68e8a10b-2663-4fcd-ad54-db0113ad8e59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:29.409621 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68e8a10b-2663-4fcd-ad54-db0113ad8e59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:29.410361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68e8a10b-2663-4fcd-ad54-db0113ad8e59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:29.411652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68e8a10b-2663-4fcd-ad54-db0113ad8e59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:29.412575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-68e8a10b-2663-4fcd-ad54-db0113ad8e59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:29.473233 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-68e8a10b-2663-4fcd-ad54-db0113ad8e59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:29.482025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-68e8a10b-2663-4fcd-ad54-db0113ad8e59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090558 Dec 15 16:49:29.482594 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1499/2794] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:30.503168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4815e4d2-c39d-4d1d-88f7-2002dece9c73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:30.504068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4815e4d2-c39d-4d1d-88f7-2002dece9c73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:30.514388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4815e4d2-c39d-4d1d-88f7-2002dece9c73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:30.515130 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4815e4d2-c39d-4d1d-88f7-2002dece9c73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:30.516406 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4815e4d2-c39d-4d1d-88f7-2002dece9c73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:30.517190 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4815e4d2-c39d-4d1d-88f7-2002dece9c73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:30.580804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4815e4d2-c39d-4d1d-88f7-2002dece9c73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:30.589077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4815e4d2-c39d-4d1d-88f7-2002dece9c73 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092525 Dec 15 16:49:30.589646 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1296/2795] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:31.610727 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3f4911ea-1063-4dd1-a6ba-c5eddd14958b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:31.611687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3f4911ea-1063-4dd1-a6ba-c5eddd14958b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:31.622485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f4911ea-1063-4dd1-a6ba-c5eddd14958b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:31.623240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f4911ea-1063-4dd1-a6ba-c5eddd14958b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:31.624527 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f4911ea-1063-4dd1-a6ba-c5eddd14958b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:31.625289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3f4911ea-1063-4dd1-a6ba-c5eddd14958b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:31.689350 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3f4911ea-1063-4dd1-a6ba-c5eddd14958b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:31.697517 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3f4911ea-1063-4dd1-a6ba-c5eddd14958b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093056 Dec 15 16:49:31.698088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1500/2796] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:32.719219 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8c6ded88-eae6-4f7a-8454-9ee65d6f22d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:32.720161 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8c6ded88-eae6-4f7a-8454-9ee65d6f22d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:32.732164 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c6ded88-eae6-4f7a-8454-9ee65d6f22d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:32.732964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c6ded88-eae6-4f7a-8454-9ee65d6f22d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:32.734260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c6ded88-eae6-4f7a-8454-9ee65d6f22d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:32.734991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8c6ded88-eae6-4f7a-8454-9ee65d6f22d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:32.798292 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8c6ded88-eae6-4f7a-8454-9ee65d6f22d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:32.807494 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8c6ded88-eae6-4f7a-8454-9ee65d6f22d9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094664 Dec 15 16:49:32.808484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1297/2797] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:33.831432 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5db5e7ab-7ff5-4d57-8621-1d55fab40bee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:33.832407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5db5e7ab-7ff5-4d57-8621-1d55fab40bee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:33.842989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5db5e7ab-7ff5-4d57-8621-1d55fab40bee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:33.843739 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5db5e7ab-7ff5-4d57-8621-1d55fab40bee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:33.845105 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5db5e7ab-7ff5-4d57-8621-1d55fab40bee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:33.846145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5db5e7ab-7ff5-4d57-8621-1d55fab40bee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:33.910849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5db5e7ab-7ff5-4d57-8621-1d55fab40bee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:33.922293 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5db5e7ab-7ff5-4d57-8621-1d55fab40bee tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096683 Dec 15 16:49:33.923201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1501/2798] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:33 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:34.948346 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-da25c476-a176-46a4-abc3-5f5b37516430 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:34.949303 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-da25c476-a176-46a4-abc3-5f5b37516430 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:34.959162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da25c476-a176-46a4-abc3-5f5b37516430 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:34.959849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da25c476-a176-46a4-abc3-5f5b37516430 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:34.961171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da25c476-a176-46a4-abc3-5f5b37516430 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:34.961756 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-da25c476-a176-46a4-abc3-5f5b37516430 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:35.028654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-da25c476-a176-46a4-abc3-5f5b37516430 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:35.036681 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-da25c476-a176-46a4-abc3-5f5b37516430 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094379 Dec 15 16:49:35.037248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1298/2799] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:36.054274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c0935117-3534-463b-a53a-704dfa916c64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:36.054910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c0935117-3534-463b-a53a-704dfa916c64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:36.063109 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0935117-3534-463b-a53a-704dfa916c64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:36.063623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0935117-3534-463b-a53a-704dfa916c64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:36.064416 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0935117-3534-463b-a53a-704dfa916c64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:36.064887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c0935117-3534-463b-a53a-704dfa916c64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:36.123710 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:49:36.124183 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:49:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:49:36.129121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c0935117-3534-463b-a53a-704dfa916c64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:36.138659 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c0935117-3534-463b-a53a-704dfa916c64 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088073 Dec 15 16:49:36.139450 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1502/2800] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:37.155732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-893ce94b-38fe-49db-b31b-c90e7e6d9574 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:37.156280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-893ce94b-38fe-49db-b31b-c90e7e6d9574 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:37.163071 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-893ce94b-38fe-49db-b31b-c90e7e6d9574 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:37.163517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-893ce94b-38fe-49db-b31b-c90e7e6d9574 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:37.164288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-893ce94b-38fe-49db-b31b-c90e7e6d9574 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:37.164907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-893ce94b-38fe-49db-b31b-c90e7e6d9574 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:37.227197 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-893ce94b-38fe-49db-b31b-c90e7e6d9574 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:37.236940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-893ce94b-38fe-49db-b31b-c90e7e6d9574 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084930 Dec 15 16:49:37.237516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1299/2801] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:37 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:38.254770 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-91e061d9-45ba-403f-87bb-7bb278e36967 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:38.255392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-91e061d9-45ba-403f-87bb-7bb278e36967 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:38.262445 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91e061d9-45ba-403f-87bb-7bb278e36967 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:38.262895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91e061d9-45ba-403f-87bb-7bb278e36967 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:38.263724 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91e061d9-45ba-403f-87bb-7bb278e36967 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:38.264162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-91e061d9-45ba-403f-87bb-7bb278e36967 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:38.324762 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-91e061d9-45ba-403f-87bb-7bb278e36967 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:38.332906 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-91e061d9-45ba-403f-87bb-7bb278e36967 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.081842 Dec 15 16:49:38.333484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1503/2802] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:39.354192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-618ed530-14f8-442d-8631-c86a071373b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:39.355249 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-618ed530-14f8-442d-8631-c86a071373b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:39.365777 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-618ed530-14f8-442d-8631-c86a071373b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:39.366468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-618ed530-14f8-442d-8631-c86a071373b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:39.367781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-618ed530-14f8-442d-8631-c86a071373b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:39.368510 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-618ed530-14f8-442d-8631-c86a071373b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:39.436864 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-618ed530-14f8-442d-8631-c86a071373b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:39.444834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-618ed530-14f8-442d-8631-c86a071373b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096859 Dec 15 16:49:39.445401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1300/2803] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:39 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:40.464936 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-61b0fcd5-afda-4e85-a971-4c161cad4ac5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:40.465506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-61b0fcd5-afda-4e85-a971-4c161cad4ac5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:40.472952 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61b0fcd5-afda-4e85-a971-4c161cad4ac5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:40.473412 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61b0fcd5-afda-4e85-a971-4c161cad4ac5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:40.474232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61b0fcd5-afda-4e85-a971-4c161cad4ac5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:40.474690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-61b0fcd5-afda-4e85-a971-4c161cad4ac5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:40.538254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-61b0fcd5-afda-4e85-a971-4c161cad4ac5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:40.546581 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-61b0fcd5-afda-4e85-a971-4c161cad4ac5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086395 Dec 15 16:49:40.547149 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1504/2804] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:41.566537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2e02df06-f260-4703-ae38-dfe5e6e0cbe2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:41.567143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2e02df06-f260-4703-ae38-dfe5e6e0cbe2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:41.574165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e02df06-f260-4703-ae38-dfe5e6e0cbe2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:41.574615 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e02df06-f260-4703-ae38-dfe5e6e0cbe2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:41.575385 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e02df06-f260-4703-ae38-dfe5e6e0cbe2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:41.575833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2e02df06-f260-4703-ae38-dfe5e6e0cbe2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:41.648680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-2e02df06-f260-4703-ae38-dfe5e6e0cbe2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:41.657542 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2e02df06-f260-4703-ae38-dfe5e6e0cbe2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094776 Dec 15 16:49:41.658124 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1301/2805] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:42.676227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-00a0831a-15a5-4b2a-83c7-8615de60c146 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:42.677050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-00a0831a-15a5-4b2a-83c7-8615de60c146 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:42.685096 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00a0831a-15a5-4b2a-83c7-8615de60c146 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:42.685547 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00a0831a-15a5-4b2a-83c7-8615de60c146 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:42.686327 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00a0831a-15a5-4b2a-83c7-8615de60c146 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:42.686761 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-00a0831a-15a5-4b2a-83c7-8615de60c146 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:42.756660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-00a0831a-15a5-4b2a-83c7-8615de60c146 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:42.765320 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-00a0831a-15a5-4b2a-83c7-8615de60c146 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094032 Dec 15 16:49:42.765894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1505/2806] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:43.062241 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:49:43.062593 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:49:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:49:43.786465 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aeca10f5-a0ed-47f6-aced-05dcd5e1cca5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:43.787442 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aeca10f5-a0ed-47f6-aced-05dcd5e1cca5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:43.795623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aeca10f5-a0ed-47f6-aced-05dcd5e1cca5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:43.796070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aeca10f5-a0ed-47f6-aced-05dcd5e1cca5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:43.796886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aeca10f5-a0ed-47f6-aced-05dcd5e1cca5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:43.797316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aeca10f5-a0ed-47f6-aced-05dcd5e1cca5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:43.870375 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aeca10f5-a0ed-47f6-aced-05dcd5e1cca5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:43.879485 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aeca10f5-a0ed-47f6-aced-05dcd5e1cca5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099265 Dec 15 16:49:43.880058 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1302/2807] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:44.901415 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-eac47e36-f1b0-47b7-b37d-781a294acd69 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:44.902388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-eac47e36-f1b0-47b7-b37d-781a294acd69 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:44.913229 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eac47e36-f1b0-47b7-b37d-781a294acd69 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:44.913957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eac47e36-f1b0-47b7-b37d-781a294acd69 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:44.915239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eac47e36-f1b0-47b7-b37d-781a294acd69 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:44.915976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-eac47e36-f1b0-47b7-b37d-781a294acd69 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:44.982042 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-eac47e36-f1b0-47b7-b37d-781a294acd69 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:44.990575 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-eac47e36-f1b0-47b7-b37d-781a294acd69 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095694 Dec 15 16:49:44.991152 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1506/2808] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:46.011901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d4f15848-dd24-459d-a8c0-368de7ba396b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:46.012556 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d4f15848-dd24-459d-a8c0-368de7ba396b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:46.019202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4f15848-dd24-459d-a8c0-368de7ba396b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:46.019651 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4f15848-dd24-459d-a8c0-368de7ba396b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:46.020468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4f15848-dd24-459d-a8c0-368de7ba396b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:46.020901 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4f15848-dd24-459d-a8c0-368de7ba396b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:46.082561 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d4f15848-dd24-459d-a8c0-368de7ba396b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:46.090886 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d4f15848-dd24-459d-a8c0-368de7ba396b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084414 Dec 15 16:49:46.091823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1303/2809] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:47.116991 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b16bbc16-ef1e-46a7-b618-1e02858d1a57 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:47.118003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b16bbc16-ef1e-46a7-b618-1e02858d1a57 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:47.125193 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16bbc16-ef1e-46a7-b618-1e02858d1a57 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:47.125644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16bbc16-ef1e-46a7-b618-1e02858d1a57 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:47.126427 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16bbc16-ef1e-46a7-b618-1e02858d1a57 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:47.126857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b16bbc16-ef1e-46a7-b618-1e02858d1a57 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:47.193191 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b16bbc16-ef1e-46a7-b618-1e02858d1a57 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:47.206188 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b16bbc16-ef1e-46a7-b618-1e02858d1a57 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095191 Dec 15 16:49:47.207063 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1507/2810] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:47 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:48.230110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cb01c4fb-b8b9-4bda-9156-3a418bdca850 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:48.230744 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cb01c4fb-b8b9-4bda-9156-3a418bdca850 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:48.238079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb01c4fb-b8b9-4bda-9156-3a418bdca850 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:48.238574 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb01c4fb-b8b9-4bda-9156-3a418bdca850 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:48.239428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb01c4fb-b8b9-4bda-9156-3a418bdca850 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:48.239904 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb01c4fb-b8b9-4bda-9156-3a418bdca850 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:48.306630 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cb01c4fb-b8b9-4bda-9156-3a418bdca850 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:48.315118 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cb01c4fb-b8b9-4bda-9156-3a418bdca850 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091436 Dec 15 16:49:48.315679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1304/2811] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:49.336649 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a5812a9a-30dc-4acd-875c-1d45affa61be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:49.337586 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a5812a9a-30dc-4acd-875c-1d45affa61be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:49.345505 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5812a9a-30dc-4acd-875c-1d45affa61be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:49.345957 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5812a9a-30dc-4acd-875c-1d45affa61be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:49.346735 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5812a9a-30dc-4acd-875c-1d45affa61be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:49.347163 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a5812a9a-30dc-4acd-875c-1d45affa61be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:49.408342 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a5812a9a-30dc-4acd-875c-1d45affa61be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:49.417059 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a5812a9a-30dc-4acd-875c-1d45affa61be tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086568 Dec 15 16:49:49.417928 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1508/2812] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:50.438669 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0753a08d-066b-4ab5-8a90-c16b4d1324d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:50.439677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0753a08d-066b-4ab5-8a90-c16b4d1324d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:50.449758 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0753a08d-066b-4ab5-8a90-c16b4d1324d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:50.450214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0753a08d-066b-4ab5-8a90-c16b4d1324d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:50.451003 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0753a08d-066b-4ab5-8a90-c16b4d1324d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:50.451440 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0753a08d-066b-4ab5-8a90-c16b4d1324d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:50.518946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0753a08d-066b-4ab5-8a90-c16b4d1324d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:50.527337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0753a08d-066b-4ab5-8a90-c16b4d1324d0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095041 Dec 15 16:49:50.527888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1305/2813] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:51.553844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e40369e2-66b2-4061-baf5-99e6b7e701cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:51.554808 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e40369e2-66b2-4061-baf5-99e6b7e701cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:51.566124 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e40369e2-66b2-4061-baf5-99e6b7e701cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:51.566984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e40369e2-66b2-4061-baf5-99e6b7e701cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:51.568289 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e40369e2-66b2-4061-baf5-99e6b7e701cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:51.569094 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e40369e2-66b2-4061-baf5-99e6b7e701cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:51.632858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-e40369e2-66b2-4061-baf5-99e6b7e701cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:51.644954 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e40369e2-66b2-4061-baf5-99e6b7e701cd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096939 Dec 15 16:49:51.645844 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1509/2814] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:52.669272 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8e0914b1-d978-4c94-9b75-f90e8702a692 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:52.669906 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8e0914b1-d978-4c94-9b75-f90e8702a692 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:52.676817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e0914b1-d978-4c94-9b75-f90e8702a692 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:52.677263 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e0914b1-d978-4c94-9b75-f90e8702a692 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:52.678045 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e0914b1-d978-4c94-9b75-f90e8702a692 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:52.678472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8e0914b1-d978-4c94-9b75-f90e8702a692 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:52.745965 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8e0914b1-d978-4c94-9b75-f90e8702a692 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:52.755472 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8e0914b1-d978-4c94-9b75-f90e8702a692 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090674 Dec 15 16:49:52.756042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1306/2815] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:53.777667 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5229db2a-b140-4ff1-9ac2-2ca5e00a3506 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:53.778669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5229db2a-b140-4ff1-9ac2-2ca5e00a3506 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:53.789274 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5229db2a-b140-4ff1-9ac2-2ca5e00a3506 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:53.789999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5229db2a-b140-4ff1-9ac2-2ca5e00a3506 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:53.791267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5229db2a-b140-4ff1-9ac2-2ca5e00a3506 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:53.792111 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5229db2a-b140-4ff1-9ac2-2ca5e00a3506 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:53.857711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5229db2a-b140-4ff1-9ac2-2ca5e00a3506 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:53.865976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5229db2a-b140-4ff1-9ac2-2ca5e00a3506 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094485 Dec 15 16:49:53.866521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1510/2816] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:53 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:54.887684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d1ccd4ef-3b2d-4daf-a6b1-20e742d6399a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:54.888720 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d1ccd4ef-3b2d-4daf-a6b1-20e742d6399a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:54.899378 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1ccd4ef-3b2d-4daf-a6b1-20e742d6399a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:54.900120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1ccd4ef-3b2d-4daf-a6b1-20e742d6399a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:54.901447 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1ccd4ef-3b2d-4daf-a6b1-20e742d6399a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:54.902113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d1ccd4ef-3b2d-4daf-a6b1-20e742d6399a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:54.963110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d1ccd4ef-3b2d-4daf-a6b1-20e742d6399a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:54.972230 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d1ccd4ef-3b2d-4daf-a6b1-20e742d6399a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090738 Dec 15 16:49:54.972822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1307/2817] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:54 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:55.992680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-196052a7-0e41-4b33-87bb-f5f74030e932 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:55.993715 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-196052a7-0e41-4b33-87bb-f5f74030e932 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:56.004795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-196052a7-0e41-4b33-87bb-f5f74030e932 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:56.005546 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-196052a7-0e41-4b33-87bb-f5f74030e932 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:56.006832 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-196052a7-0e41-4b33-87bb-f5f74030e932 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:56.007537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-196052a7-0e41-4b33-87bb-f5f74030e932 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:56.071926 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-196052a7-0e41-4b33-87bb-f5f74030e932 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:56.084680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-196052a7-0e41-4b33-87bb-f5f74030e932 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097825 Dec 15 16:49:56.085454 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1511/2818] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:57.108104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0481047a-a86e-4dec-8c39-4935847d6fda tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:57.109240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0481047a-a86e-4dec-8c39-4935847d6fda tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:57.119667 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0481047a-a86e-4dec-8c39-4935847d6fda tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:57.120370 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0481047a-a86e-4dec-8c39-4935847d6fda tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:57.121514 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0481047a-a86e-4dec-8c39-4935847d6fda tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:57.121940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0481047a-a86e-4dec-8c39-4935847d6fda tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:57.183462 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0481047a-a86e-4dec-8c39-4935847d6fda tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:57.192049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0481047a-a86e-4dec-8c39-4935847d6fda tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090103 Dec 15 16:49:57.192671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1308/2819] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:57 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:58.215382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-23a673a3-0a2f-4c25-80c8-10e53af7edf7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:58.216871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-23a673a3-0a2f-4c25-80c8-10e53af7edf7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:58.227652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23a673a3-0a2f-4c25-80c8-10e53af7edf7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:58.228402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23a673a3-0a2f-4c25-80c8-10e53af7edf7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:58.229754 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23a673a3-0a2f-4c25-80c8-10e53af7edf7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:58.230606 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-23a673a3-0a2f-4c25-80c8-10e53af7edf7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:58.294259 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-23a673a3-0a2f-4c25-80c8-10e53af7edf7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:58.302666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-23a673a3-0a2f-4c25-80c8-10e53af7edf7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093426 Dec 15 16:49:58.303208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1512/2820] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:49:59.319766 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-f122136a-b089-4d17-9a2f-fdf677afbc56 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:49:59.320466 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-f122136a-b089-4d17-9a2f-fdf677afbc56 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:49:59.327046 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f122136a-b089-4d17-9a2f-fdf677afbc56 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:59.327536 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f122136a-b089-4d17-9a2f-fdf677afbc56 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:59.328319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f122136a-b089-4d17-9a2f-fdf677afbc56 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:49:59.328797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-f122136a-b089-4d17-9a2f-fdf677afbc56 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:49:59.388832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-f122136a-b089-4d17-9a2f-fdf677afbc56 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:49:59.396821 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-f122136a-b089-4d17-9a2f-fdf677afbc56 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.080747 Dec 15 16:49:59.397391 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1309/2821] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:49:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:00.414709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0e4cce03-cd6d-4f38-b00b-bbb441388963 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:00.415312 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0e4cce03-cd6d-4f38-b00b-bbb441388963 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:00.422777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e4cce03-cd6d-4f38-b00b-bbb441388963 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:00.423227 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e4cce03-cd6d-4f38-b00b-bbb441388963 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:00.424004 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e4cce03-cd6d-4f38-b00b-bbb441388963 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:00.424481 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e4cce03-cd6d-4f38-b00b-bbb441388963 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:00.488669 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e4cce03-cd6d-4f38-b00b-bbb441388963 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:00.497247 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0e4cce03-cd6d-4f38-b00b-bbb441388963 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086894 Dec 15 16:50:00.497822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1513/2822] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:01.518371 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-eace7770-03ce-4f52-870d-4a30d958de70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:01.519246 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-eace7770-03ce-4f52-870d-4a30d958de70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:01.529179 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eace7770-03ce-4f52-870d-4a30d958de70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:01.529633 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eace7770-03ce-4f52-870d-4a30d958de70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:01.530414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eace7770-03ce-4f52-870d-4a30d958de70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:01.530857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-eace7770-03ce-4f52-870d-4a30d958de70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:01.590262 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-eace7770-03ce-4f52-870d-4a30d958de70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:01.598775 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-eace7770-03ce-4f52-870d-4a30d958de70 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086812 Dec 15 16:50:01.599350 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1310/2823] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:02.619697 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-256141fd-42a1-433f-bff4-a3e56d6d7608 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:02.620767 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-256141fd-42a1-433f-bff4-a3e56d6d7608 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:02.632919 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-256141fd-42a1-433f-bff4-a3e56d6d7608 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:02.633674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-256141fd-42a1-433f-bff4-a3e56d6d7608 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:02.634959 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-256141fd-42a1-433f-bff4-a3e56d6d7608 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:02.635686 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-256141fd-42a1-433f-bff4-a3e56d6d7608 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:02.697142 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-256141fd-42a1-433f-bff4-a3e56d6d7608 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:02.705377 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-256141fd-42a1-433f-bff4-a3e56d6d7608 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091886 Dec 15 16:50:02.705945 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1514/2824] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:03.726186 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-30f02ac3-7bec-4531-8741-46b2a7599f59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:03.727136 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-30f02ac3-7bec-4531-8741-46b2a7599f59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:03.738065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-30f02ac3-7bec-4531-8741-46b2a7599f59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:03.738820 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-30f02ac3-7bec-4531-8741-46b2a7599f59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:03.740128 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-30f02ac3-7bec-4531-8741-46b2a7599f59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:03.740955 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-30f02ac3-7bec-4531-8741-46b2a7599f59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:03.808732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-30f02ac3-7bec-4531-8741-46b2a7599f59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:03.817256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-30f02ac3-7bec-4531-8741-46b2a7599f59 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097263 Dec 15 16:50:03.817797 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1311/2825] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:04.838760 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-36da65f6-d43c-4585-8f44-27bf205ae149 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:04.839783 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-36da65f6-d43c-4585-8f44-27bf205ae149 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:04.850728 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36da65f6-d43c-4585-8f44-27bf205ae149 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:04.851485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36da65f6-d43c-4585-8f44-27bf205ae149 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:04.852823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36da65f6-d43c-4585-8f44-27bf205ae149 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:04.853564 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-36da65f6-d43c-4585-8f44-27bf205ae149 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:04.913323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-36da65f6-d43c-4585-8f44-27bf205ae149 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:04.921390 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-36da65f6-d43c-4585-8f44-27bf205ae149 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089079 Dec 15 16:50:04.921983 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1515/2826] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:04 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:05.943047 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1029380d-200f-450b-a854-430cbd69c5fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:05.944096 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1029380d-200f-450b-a854-430cbd69c5fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:05.954861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1029380d-200f-450b-a854-430cbd69c5fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:05.955609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1029380d-200f-450b-a854-430cbd69c5fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:05.957002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1029380d-200f-450b-a854-430cbd69c5fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:05.957730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1029380d-200f-450b-a854-430cbd69c5fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:06.023021 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1029380d-200f-450b-a854-430cbd69c5fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:06.031537 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1029380d-200f-450b-a854-430cbd69c5fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094699 Dec 15 16:50:06.032122 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1312/2827] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:07.052966 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4e6972d4-036e-4fed-a0fe-146d52859770 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:07.053920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4e6972d4-036e-4fed-a0fe-146d52859770 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:07.064361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e6972d4-036e-4fed-a0fe-146d52859770 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:07.065190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e6972d4-036e-4fed-a0fe-146d52859770 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:07.066473 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e6972d4-036e-4fed-a0fe-146d52859770 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:07.067226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e6972d4-036e-4fed-a0fe-146d52859770 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:07.141278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4e6972d4-036e-4fed-a0fe-146d52859770 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:07.149577 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4e6972d4-036e-4fed-a0fe-146d52859770 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.102693 Dec 15 16:50:07.150148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1516/2828] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:07 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:08.167655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-a26d8955-70c8-4382-b1ee-12af3cea612b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:08.168242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-a26d8955-70c8-4382-b1ee-12af3cea612b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:08.177394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a26d8955-70c8-4382-b1ee-12af3cea612b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:08.177866 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a26d8955-70c8-4382-b1ee-12af3cea612b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:08.178670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a26d8955-70c8-4382-b1ee-12af3cea612b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:08.179076 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-a26d8955-70c8-4382-b1ee-12af3cea612b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:08.244780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-a26d8955-70c8-4382-b1ee-12af3cea612b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:08.254664 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-a26d8955-70c8-4382-b1ee-12af3cea612b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090822 Dec 15 16:50:08.255242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1313/2829] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:09.271972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0e2c6811-8b04-4554-b1be-31a6cb2efed0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:09.272603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0e2c6811-8b04-4554-b1be-31a6cb2efed0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:09.279565 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e2c6811-8b04-4554-b1be-31a6cb2efed0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:09.280019 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e2c6811-8b04-4554-b1be-31a6cb2efed0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:09.281388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e2c6811-8b04-4554-b1be-31a6cb2efed0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:09.281835 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0e2c6811-8b04-4554-b1be-31a6cb2efed0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:09.344562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0e2c6811-8b04-4554-b1be-31a6cb2efed0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:09.352619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0e2c6811-8b04-4554-b1be-31a6cb2efed0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084359 Dec 15 16:50:09.353194 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1517/2830] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:10.370093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-076be518-1780-43df-826a-366d4d283d77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:10.370704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-076be518-1780-43df-826a-366d4d283d77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:10.377539 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-076be518-1780-43df-826a-366d4d283d77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:10.377923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-076be518-1780-43df-826a-366d4d283d77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:10.378693 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-076be518-1780-43df-826a-366d4d283d77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:10.379123 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-076be518-1780-43df-826a-366d4d283d77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:10.441704 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-076be518-1780-43df-826a-366d4d283d77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:10.453517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-076be518-1780-43df-826a-366d4d283d77 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086951 Dec 15 16:50:10.454281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1314/2831] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:10 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:11.479468 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7fbc2bed-c158-4ed3-9967-206fc237af80 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:11.480365 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7fbc2bed-c158-4ed3-9967-206fc237af80 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:11.488696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7fbc2bed-c158-4ed3-9967-206fc237af80 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:11.489147 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7fbc2bed-c158-4ed3-9967-206fc237af80 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:11.489939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7fbc2bed-c158-4ed3-9967-206fc237af80 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:11.490374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7fbc2bed-c158-4ed3-9967-206fc237af80 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:11.553380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7fbc2bed-c158-4ed3-9967-206fc237af80 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:11.565381 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7fbc2bed-c158-4ed3-9967-206fc237af80 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092208 Dec 15 16:50:11.566093 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1518/2832] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:11 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:12.591168 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8262d3aa-b28f-409c-85d7-6b7b0b463e7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:12.592192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8262d3aa-b28f-409c-85d7-6b7b0b463e7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:12.599692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8262d3aa-b28f-409c-85d7-6b7b0b463e7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:12.600165 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8262d3aa-b28f-409c-85d7-6b7b0b463e7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:12.601032 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8262d3aa-b28f-409c-85d7-6b7b0b463e7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:12.601486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8262d3aa-b28f-409c-85d7-6b7b0b463e7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:12.662028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8262d3aa-b28f-409c-85d7-6b7b0b463e7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:12.670000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8262d3aa-b28f-409c-85d7-6b7b0b463e7d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.085519 Dec 15 16:50:12.670567 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1315/2833] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:12 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:13.691074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-860f09a1-70d6-45f7-ade1-4845ff2ab534 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:13.692029 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-860f09a1-70d6-45f7-ade1-4845ff2ab534 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:13.702804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-860f09a1-70d6-45f7-ade1-4845ff2ab534 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:13.703286 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-860f09a1-70d6-45f7-ade1-4845ff2ab534 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:13.704069 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-860f09a1-70d6-45f7-ade1-4845ff2ab534 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:13.704535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-860f09a1-70d6-45f7-ade1-4845ff2ab534 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:13.775246 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-860f09a1-70d6-45f7-ade1-4845ff2ab534 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:13.783383 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-860f09a1-70d6-45f7-ade1-4845ff2ab534 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098688 Dec 15 16:50:13.783920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1519/2834] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:13 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:14.804405 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7b33ba70-dc6d-4c0a-95ac-c24edd594d63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:14.805428 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7b33ba70-dc6d-4c0a-95ac-c24edd594d63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:14.814480 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b33ba70-dc6d-4c0a-95ac-c24edd594d63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:14.814925 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b33ba70-dc6d-4c0a-95ac-c24edd594d63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:14.815700 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b33ba70-dc6d-4c0a-95ac-c24edd594d63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:14.816138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7b33ba70-dc6d-4c0a-95ac-c24edd594d63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:14.876483 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7b33ba70-dc6d-4c0a-95ac-c24edd594d63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:14.884507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7b33ba70-dc6d-4c0a-95ac-c24edd594d63 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086255 Dec 15 16:50:14.885078 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1316/2835] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:14 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:15.905382 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-52adf338-99e6-4bcb-98e2-6caa509bc7fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:15.906367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-52adf338-99e6-4bcb-98e2-6caa509bc7fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:15.917785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52adf338-99e6-4bcb-98e2-6caa509bc7fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:15.918543 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52adf338-99e6-4bcb-98e2-6caa509bc7fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:15.919851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52adf338-99e6-4bcb-98e2-6caa509bc7fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:15.920634 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52adf338-99e6-4bcb-98e2-6caa509bc7fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:15.990537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-52adf338-99e6-4bcb-98e2-6caa509bc7fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:16.000793 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-52adf338-99e6-4bcb-98e2-6caa509bc7fd tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.101066 Dec 15 16:50:16.001719 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1520/2836] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:15 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:17.027658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-fff665ec-c601-4e46-a5cd-136985e2e7b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:17.028692 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-fff665ec-c601-4e46-a5cd-136985e2e7b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:17.036946 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fff665ec-c601-4e46-a5cd-136985e2e7b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:17.037388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fff665ec-c601-4e46-a5cd-136985e2e7b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:17.038163 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fff665ec-c601-4e46-a5cd-136985e2e7b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:17.038587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-fff665ec-c601-4e46-a5cd-136985e2e7b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:17.101182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-fff665ec-c601-4e46-a5cd-136985e2e7b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:17.109675 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-fff665ec-c601-4e46-a5cd-136985e2e7b9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.088093 Dec 15 16:50:17.110414 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1317/2837] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:17 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:18.133702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5f25a692-09b8-47fb-9350-250d6d21467f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:18.134856 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5f25a692-09b8-47fb-9350-250d6d21467f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:18.144270 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f25a692-09b8-47fb-9350-250d6d21467f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:18.144745 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f25a692-09b8-47fb-9350-250d6d21467f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:18.145516 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f25a692-09b8-47fb-9350-250d6d21467f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:18.145951 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5f25a692-09b8-47fb-9350-250d6d21467f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:18.205631 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-5f25a692-09b8-47fb-9350-250d6d21467f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:18.214363 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5f25a692-09b8-47fb-9350-250d6d21467f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086912 Dec 15 16:50:18.214931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1521/2838] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:18 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:19.234952 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c2ab881b-2ed5-4503-a112-a3d2da687226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:19.235940 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c2ab881b-2ed5-4503-a112-a3d2da687226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:19.246459 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c2ab881b-2ed5-4503-a112-a3d2da687226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:19.247231 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c2ab881b-2ed5-4503-a112-a3d2da687226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:19.248530 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c2ab881b-2ed5-4503-a112-a3d2da687226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:19.249278 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c2ab881b-2ed5-4503-a112-a3d2da687226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:19.311893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-c2ab881b-2ed5-4503-a112-a3d2da687226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:19.321100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c2ab881b-2ed5-4503-a112-a3d2da687226 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092303 Dec 15 16:50:19.321679 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1318/2839] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:19 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:20.338688 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-351a4c14-c527-4de9-bb40-b7241c007a33 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:20.339307 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-351a4c14-c527-4de9-bb40-b7241c007a33 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:20.346576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-351a4c14-c527-4de9-bb40-b7241c007a33 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:20.347054 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-351a4c14-c527-4de9-bb40-b7241c007a33 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:20.347858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-351a4c14-c527-4de9-bb40-b7241c007a33 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:20.348285 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-351a4c14-c527-4de9-bb40-b7241c007a33 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:20.410145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-351a4c14-c527-4de9-bb40-b7241c007a33 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:20.418224 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-351a4c14-c527-4de9-bb40-b7241c007a33 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083228 Dec 15 16:50:20.418794 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1522/2840] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:20 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:21.439608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ac1b0333-c7fc-445e-97f3-f44098e6971e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:21.440394 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ac1b0333-c7fc-445e-97f3-f44098e6971e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:21.448616 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ac1b0333-c7fc-445e-97f3-f44098e6971e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:21.449176 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ac1b0333-c7fc-445e-97f3-f44098e6971e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:21.450137 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ac1b0333-c7fc-445e-97f3-f44098e6971e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:21.450654 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ac1b0333-c7fc-445e-97f3-f44098e6971e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:21.517288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ac1b0333-c7fc-445e-97f3-f44098e6971e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:21.525647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ac1b0333-c7fc-445e-97f3-f44098e6971e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092832 Dec 15 16:50:21.526216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1319/2841] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:21 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:22.546664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-510f97a2-0615-4bcc-9d7a-ef41f86c6be8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:22.547748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-510f97a2-0615-4bcc-9d7a-ef41f86c6be8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:22.554480 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-510f97a2-0615-4bcc-9d7a-ef41f86c6be8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:22.554924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-510f97a2-0615-4bcc-9d7a-ef41f86c6be8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:22.555695 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-510f97a2-0615-4bcc-9d7a-ef41f86c6be8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:22.556121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-510f97a2-0615-4bcc-9d7a-ef41f86c6be8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:22.623192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-510f97a2-0615-4bcc-9d7a-ef41f86c6be8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:22.631797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-510f97a2-0615-4bcc-9d7a-ef41f86c6be8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091413 Dec 15 16:50:22.632362 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1523/2842] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:22 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:23.653254 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-8db6f5b6-fa8c-43d9-b23f-8ca690a93445 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:23.654270 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-8db6f5b6-fa8c-43d9-b23f-8ca690a93445 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:23.662132 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8db6f5b6-fa8c-43d9-b23f-8ca690a93445 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:23.662586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8db6f5b6-fa8c-43d9-b23f-8ca690a93445 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:23.663369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8db6f5b6-fa8c-43d9-b23f-8ca690a93445 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:23.663803 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-8db6f5b6-fa8c-43d9-b23f-8ca690a93445 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:23.731478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-8db6f5b6-fa8c-43d9-b23f-8ca690a93445 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:23.740195 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-8db6f5b6-fa8c-43d9-b23f-8ca690a93445 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093219 Dec 15 16:50:23.740812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1320/2843] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:23 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:24.764818 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-c8ec0cc9-f1f5-405d-88e6-07791ec23667 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:24.765747 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-c8ec0cc9-f1f5-405d-88e6-07791ec23667 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:24.772764 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c8ec0cc9-f1f5-405d-88e6-07791ec23667 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:24.773214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c8ec0cc9-f1f5-405d-88e6-07791ec23667 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:24.773995 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c8ec0cc9-f1f5-405d-88e6-07791ec23667 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:24.774429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-c8ec0cc9-f1f5-405d-88e6-07791ec23667 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:24.842756 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-c8ec0cc9-f1f5-405d-88e6-07791ec23667 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:24.851207 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-c8ec0cc9-f1f5-405d-88e6-07791ec23667 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092692 Dec 15 16:50:24.851776 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1524/2844] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:24 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:25.872318 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-4d153c86-5c83-4530-add6-4b38a1917bb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:25.873339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-4d153c86-5c83-4530-add6-4b38a1917bb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:25.881478 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d153c86-5c83-4530-add6-4b38a1917bb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:25.881922 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d153c86-5c83-4530-add6-4b38a1917bb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:25.882699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d153c86-5c83-4530-add6-4b38a1917bb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:25.883185 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-4d153c86-5c83-4530-add6-4b38a1917bb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:25.943202 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-4d153c86-5c83-4530-add6-4b38a1917bb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:25.952172 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-4d153c86-5c83-4530-add6-4b38a1917bb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086097 Dec 15 16:50:25.952792 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1321/2845] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:25 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:26.975344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-14b25c69-e67b-477e-8dda-d3e8507f905c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:26.976011 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-14b25c69-e67b-477e-8dda-d3e8507f905c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:26.982883 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14b25c69-e67b-477e-8dda-d3e8507f905c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:26.983336 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14b25c69-e67b-477e-8dda-d3e8507f905c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:26.984119 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14b25c69-e67b-477e-8dda-d3e8507f905c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:26.984580 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-14b25c69-e67b-477e-8dda-d3e8507f905c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:27.047696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-14b25c69-e67b-477e-8dda-d3e8507f905c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:27.055965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-14b25c69-e67b-477e-8dda-d3e8507f905c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.084376 Dec 15 16:50:27.056529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1525/2846] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:26 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:28.081832 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9096b155-397e-4495-a818-6d942c363a38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:28.082512 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9096b155-397e-4495-a818-6d942c363a38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:28.090049 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9096b155-397e-4495-a818-6d942c363a38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:28.090950 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9096b155-397e-4495-a818-6d942c363a38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:28.091869 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9096b155-397e-4495-a818-6d942c363a38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:28.092382 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9096b155-397e-4495-a818-6d942c363a38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:28.167849 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9096b155-397e-4495-a818-6d942c363a38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:28.178891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9096b155-397e-4495-a818-6d942c363a38 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.102176 Dec 15 16:50:28.179665 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1322/2847] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:28 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:29.195701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-9ab6b93e-77c4-4583-93ef-e6cea8e17129 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:29.196313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-9ab6b93e-77c4-4583-93ef-e6cea8e17129 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:29.203129 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ab6b93e-77c4-4583-93ef-e6cea8e17129 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:29.203571 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ab6b93e-77c4-4583-93ef-e6cea8e17129 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:29.204485 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ab6b93e-77c4-4583-93ef-e6cea8e17129 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:29.204939 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-9ab6b93e-77c4-4583-93ef-e6cea8e17129 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:29.266784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-9ab6b93e-77c4-4583-93ef-e6cea8e17129 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:29.275301 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-9ab6b93e-77c4-4583-93ef-e6cea8e17129 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.083236 Dec 15 16:50:29.275870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1526/2848] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:29 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:30.296944 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5167b67a-cecd-44cc-84ce-1ec36f621956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:30.297908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5167b67a-cecd-44cc-84ce-1ec36f621956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:30.308274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5167b67a-cecd-44cc-84ce-1ec36f621956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:30.309068 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5167b67a-cecd-44cc-84ce-1ec36f621956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:30.310339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5167b67a-cecd-44cc-84ce-1ec36f621956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:30.311054 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5167b67a-cecd-44cc-84ce-1ec36f621956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:30.374241 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5167b67a-cecd-44cc-84ce-1ec36f621956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:30.382811 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5167b67a-cecd-44cc-84ce-1ec36f621956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092312 Dec 15 16:50:30.383319 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1323/2849] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:30 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:31.403653 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8fc5fbab-9dac-4e43-8fd2-f7aaa75145ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:31.404591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8fc5fbab-9dac-4e43-8fd2-f7aaa75145ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:31.415542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fc5fbab-9dac-4e43-8fd2-f7aaa75145ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:31.416283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fc5fbab-9dac-4e43-8fd2-f7aaa75145ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:31.417618 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fc5fbab-9dac-4e43-8fd2-f7aaa75145ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:31.418323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fc5fbab-9dac-4e43-8fd2-f7aaa75145ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:31.481135 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8fc5fbab-9dac-4e43-8fd2-f7aaa75145ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:31.489488 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8fc5fbab-9dac-4e43-8fd2-f7aaa75145ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092073 Dec 15 16:50:31.490060 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1527/2850] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:31 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:32.508893 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-df2006b8-6d21-4f9f-abaa-d2e6c4a02baa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:32.509590 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-df2006b8-6d21-4f9f-abaa-d2e6c4a02baa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:32.517801 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df2006b8-6d21-4f9f-abaa-d2e6c4a02baa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:32.518687 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df2006b8-6d21-4f9f-abaa-d2e6c4a02baa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:32.519658 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df2006b8-6d21-4f9f-abaa-d2e6c4a02baa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:32.520204 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-df2006b8-6d21-4f9f-abaa-d2e6c4a02baa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:32.582867 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-df2006b8-6d21-4f9f-abaa-d2e6c4a02baa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:32.594337 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-df2006b8-6d21-4f9f-abaa-d2e6c4a02baa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089840 Dec 15 16:50:32.595253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1324/2851] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:32 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:33.614240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-647ad65c-9066-4b6c-bcaa-6d777a62140a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:33.614873 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-647ad65c-9066-4b6c-bcaa-6d777a62140a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:33.621255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-647ad65c-9066-4b6c-bcaa-6d777a62140a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:33.621703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-647ad65c-9066-4b6c-bcaa-6d777a62140a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:33.622477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-647ad65c-9066-4b6c-bcaa-6d777a62140a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:33.622925 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-647ad65c-9066-4b6c-bcaa-6d777a62140a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:33.692894 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-647ad65c-9066-4b6c-bcaa-6d777a62140a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:33.701231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-647ad65c-9066-4b6c-bcaa-6d777a62140a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092250 Dec 15 16:50:33.701773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1528/2852] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:33 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:34.722608 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d915962d-6e41-4417-a6ca-de411816021c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:34.723342 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d915962d-6e41-4417-a6ca-de411816021c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:34.731474 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d915962d-6e41-4417-a6ca-de411816021c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:34.732028 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d915962d-6e41-4417-a6ca-de411816021c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:34.733037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d915962d-6e41-4417-a6ca-de411816021c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:34.733577 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d915962d-6e41-4417-a6ca-de411816021c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:34.801545 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d915962d-6e41-4417-a6ca-de411816021c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:34.809895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d915962d-6e41-4417-a6ca-de411816021c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.093163 Dec 15 16:50:34.810438 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1325/2853] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:34 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:35.831261 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-020f37d6-c315-4099-93be-f93c38904372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:35.832087 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-020f37d6-c315-4099-93be-f93c38904372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:35.841070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-020f37d6-c315-4099-93be-f93c38904372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:35.841661 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-020f37d6-c315-4099-93be-f93c38904372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:35.842687 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-020f37d6-c315-4099-93be-f93c38904372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:35.843268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-020f37d6-c315-4099-93be-f93c38904372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:35.907604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-020f37d6-c315-4099-93be-f93c38904372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:35.915639 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-020f37d6-c315-4099-93be-f93c38904372 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090596 Dec 15 16:50:35.916208 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1529/2854] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:35 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:36.937540 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ff77103d-b78e-4493-85a8-a23cff445f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:36.938548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ff77103d-b78e-4493-85a8-a23cff445f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:36.949387 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff77103d-b78e-4493-85a8-a23cff445f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:36.950877 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff77103d-b78e-4493-85a8-a23cff445f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:36.952173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff77103d-b78e-4493-85a8-a23cff445f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:36.952945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ff77103d-b78e-4493-85a8-a23cff445f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:37.014979 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ff77103d-b78e-4493-85a8-a23cff445f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:37.023000 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ff77103d-b78e-4493-85a8-a23cff445f8a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091650 Dec 15 16:50:37.023570 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1326/2855] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:38.040361 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1ceb583c-cd19-49cb-957d-ad8cfecebc1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:38.040986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1ceb583c-cd19-49cb-957d-ad8cfecebc1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:38.047886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ceb583c-cd19-49cb-957d-ad8cfecebc1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:38.048331 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ceb583c-cd19-49cb-957d-ad8cfecebc1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:38.049148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ceb583c-cd19-49cb-957d-ad8cfecebc1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:38.049576 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1ceb583c-cd19-49cb-957d-ad8cfecebc1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:38.115175 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1ceb583c-cd19-49cb-957d-ad8cfecebc1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:38.123242 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1ceb583c-cd19-49cb-957d-ad8cfecebc1a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087027 Dec 15 16:50:38.123791 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1530/2856] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:38 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:39.148214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-9e63d09c-3cd5-497a-b7cc-346493a54779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:39.149229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-9e63d09c-3cd5-497a-b7cc-346493a54779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:39.156323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9e63d09c-3cd5-497a-b7cc-346493a54779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:39.156850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9e63d09c-3cd5-497a-b7cc-346493a54779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:39.157637 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9e63d09c-3cd5-497a-b7cc-346493a54779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:39.158273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-9e63d09c-3cd5-497a-b7cc-346493a54779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:39.231814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-9e63d09c-3cd5-497a-b7cc-346493a54779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:39.240120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-9e63d09c-3cd5-497a-b7cc-346493a54779 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.099224 Dec 15 16:50:39.241323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1327/2857] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:39 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:40.262123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2481474f-ecf7-487e-8ae5-0efae8dd524e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:40.263086 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2481474f-ecf7-487e-8ae5-0efae8dd524e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:40.274568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2481474f-ecf7-487e-8ae5-0efae8dd524e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:40.275313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2481474f-ecf7-487e-8ae5-0efae8dd524e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:40.276666 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2481474f-ecf7-487e-8ae5-0efae8dd524e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:40.277389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2481474f-ecf7-487e-8ae5-0efae8dd524e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:40.350295 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2481474f-ecf7-487e-8ae5-0efae8dd524e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:40.358680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2481474f-ecf7-487e-8ae5-0efae8dd524e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.103128 Dec 15 16:50:40.359255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1531/2858] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:40 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:41.379228 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b8dcab21-84bc-401d-9903-ac3238ac012f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:41.380098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b8dcab21-84bc-401d-9903-ac3238ac012f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:41.390887 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b8dcab21-84bc-401d-9903-ac3238ac012f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:41.391640 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b8dcab21-84bc-401d-9903-ac3238ac012f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:41.392981 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b8dcab21-84bc-401d-9903-ac3238ac012f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:41.393714 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b8dcab21-84bc-401d-9903-ac3238ac012f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:41.455408 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b8dcab21-84bc-401d-9903-ac3238ac012f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:41.463668 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b8dcab21-84bc-401d-9903-ac3238ac012f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090790 Dec 15 16:50:41.464251 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1328/2859] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:41 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:42.485162 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-833c424d-2358-403a-a491-4099c1b120d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:42.486099 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-833c424d-2358-403a-a491-4099c1b120d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:42.496882 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-833c424d-2358-403a-a491-4099c1b120d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:42.497629 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-833c424d-2358-403a-a491-4099c1b120d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:42.498918 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-833c424d-2358-403a-a491-4099c1b120d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:42.499708 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-833c424d-2358-403a-a491-4099c1b120d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:42.563214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-833c424d-2358-403a-a491-4099c1b120d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:42.571438 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-833c424d-2358-403a-a491-4099c1b120d6 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.092584 Dec 15 16:50:42.572002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1532/2860] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:42 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:43.144018 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:50:43.144234 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:50:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:50:43.592725 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d4037263-732f-4284-8a22-b071785e907b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:43.593730 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d4037263-732f-4284-8a22-b071785e907b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:43.604996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4037263-732f-4284-8a22-b071785e907b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:43.605747 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4037263-732f-4284-8a22-b071785e907b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:43.607133 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4037263-732f-4284-8a22-b071785e907b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:43.607857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4037263-732f-4284-8a22-b071785e907b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:43.674742 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-d4037263-732f-4284-8a22-b071785e907b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:43.683092 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d4037263-732f-4284-8a22-b071785e907b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096949 Dec 15 16:50:43.683670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1329/2861] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:43 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:50:44.699914 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-be80bea1-465d-4cb7-92a7-30b84eb8c860 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:44.700572 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-be80bea1-465d-4cb7-92a7-30b84eb8c860 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:44.707388 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-be80bea1-465d-4cb7-92a7-30b84eb8c860 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:44.707836 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-be80bea1-465d-4cb7-92a7-30b84eb8c860 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:44.708647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-be80bea1-465d-4cb7-92a7-30b84eb8c860 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:44.709344 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-be80bea1-465d-4cb7-92a7-30b84eb8c860 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:44.771615 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-be80bea1-465d-4cb7-92a7-30b84eb8c860 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:44.784398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-be80bea1-465d-4cb7-92a7-30b84eb8c860 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087992 Dec 15 16:50:44.785345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1533/2862] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:44 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:45.807057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1a9df090-6316-408a-b1f9-34ad7dd276e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:45.808059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1a9df090-6316-408a-b1f9-34ad7dd276e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:45.818824 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a9df090-6316-408a-b1f9-34ad7dd276e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:45.819839 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a9df090-6316-408a-b1f9-34ad7dd276e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:45.821210 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a9df090-6316-408a-b1f9-34ad7dd276e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:45.821953 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1a9df090-6316-408a-b1f9-34ad7dd276e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:45.889079 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1a9df090-6316-408a-b1f9-34ad7dd276e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:45.900456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1a9df090-6316-408a-b1f9-34ad7dd276e4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.100205 Dec 15 16:50:45.901014 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1330/2863] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:45 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:46.921889 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-990ac774-b78b-42f1-ab0d-f28c90cea5a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:46.922877 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-990ac774-b78b-42f1-ab0d-f28c90cea5a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:46.933588 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-990ac774-b78b-42f1-ab0d-f28c90cea5a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:46.934333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-990ac774-b78b-42f1-ab0d-f28c90cea5a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:46.935616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-990ac774-b78b-42f1-ab0d-f28c90cea5a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:46.936323 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-990ac774-b78b-42f1-ab0d-f28c90cea5a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:47.002880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-990ac774-b78b-42f1-ab0d-f28c90cea5a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:47.011112 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-990ac774-b78b-42f1-ab0d-f28c90cea5a2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095395 Dec 15 16:50:47.011674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1534/2864] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:46 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:48.028895 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b19bbe91-c402-42b4-bae7-50e5ca48d7b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:48.029547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b19bbe91-c402-42b4-bae7-50e5ca48d7b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:48.037398 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b19bbe91-c402-42b4-bae7-50e5ca48d7b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:48.037786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b19bbe91-c402-42b4-bae7-50e5ca48d7b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:48.038671 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b19bbe91-c402-42b4-bae7-50e5ca48d7b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:48.039162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b19bbe91-c402-42b4-bae7-50e5ca48d7b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:48.103187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b19bbe91-c402-42b4-bae7-50e5ca48d7b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:48.115501 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b19bbe91-c402-42b4-bae7-50e5ca48d7b4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.090229 Dec 15 16:50:48.116002 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1331/2865] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:48 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:49.134670 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-25e3c0de-25d7-44c9-85e7-2089ea4c5d78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:49.135292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-25e3c0de-25d7-44c9-85e7-2089ea4c5d78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:49.142097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25e3c0de-25d7-44c9-85e7-2089ea4c5d78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:49.142555 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25e3c0de-25d7-44c9-85e7-2089ea4c5d78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:49.143353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25e3c0de-25d7-44c9-85e7-2089ea4c5d78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:49.143795 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-25e3c0de-25d7-44c9-85e7-2089ea4c5d78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:49.203679 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-25e3c0de-25d7-44c9-85e7-2089ea4c5d78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:49.211843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-25e3c0de-25d7-44c9-85e7-2089ea4c5d78 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.081434 Dec 15 16:50:49.212414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1535/2866] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:49 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:50.233187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5544c29b-6c7b-47c6-ac45-5c47e5366d9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:50.234288 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5544c29b-6c7b-47c6-ac45-5c47e5366d9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:50.243344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5544c29b-6c7b-47c6-ac45-5c47e5366d9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:50.243798 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5544c29b-6c7b-47c6-ac45-5c47e5366d9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:50.244624 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5544c29b-6c7b-47c6-ac45-5c47e5366d9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:50.245065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5544c29b-6c7b-47c6-ac45-5c47e5366d9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:50.360100 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-5544c29b-6c7b-47c6-ac45-5c47e5366d9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:50.368885 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5544c29b-6c7b-47c6-ac45-5c47e5366d9e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.141879 Dec 15 16:50:50.369468 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1332/2867] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:50 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:50.669065 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:50:50.669682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:50:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:50:51.390562 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0aecbfa6-749b-440f-9464-8718ba3c9dd7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:51.391567 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0aecbfa6-749b-440f-9464-8718ba3c9dd7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:51.402328 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0aecbfa6-749b-440f-9464-8718ba3c9dd7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:51.403068 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0aecbfa6-749b-440f-9464-8718ba3c9dd7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:51.404352 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0aecbfa6-749b-440f-9464-8718ba3c9dd7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:51.405144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0aecbfa6-749b-440f-9464-8718ba3c9dd7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:51.467711 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-0aecbfa6-749b-440f-9464-8718ba3c9dd7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:51.475941 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0aecbfa6-749b-440f-9464-8718ba3c9dd7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091703 Dec 15 16:50:51.476537 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1536/2868] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:51 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:52.493099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3c30ea76-0f1b-4ef8-b465-571368872602 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:52.493691 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3c30ea76-0f1b-4ef8-b465-571368872602 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:52.500576 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c30ea76-0f1b-4ef8-b465-571368872602 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:52.501026 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c30ea76-0f1b-4ef8-b465-571368872602 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:52.501806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c30ea76-0f1b-4ef8-b465-571368872602 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:52.502239 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3c30ea76-0f1b-4ef8-b465-571368872602 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:52.570146 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-3c30ea76-0f1b-4ef8-b465-571368872602 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:52.578470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3c30ea76-0f1b-4ef8-b465-571368872602 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.089173 Dec 15 16:50:52.579037 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1333/2869] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:52 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:53.602392 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4871fc7a-d162-4761-83eb-949db2f8086d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:53.603015 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4871fc7a-d162-4761-83eb-949db2f8086d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:53.609738 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4871fc7a-d162-4761-83eb-949db2f8086d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:53.610190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4871fc7a-d162-4761-83eb-949db2f8086d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:53.610976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4871fc7a-d162-4761-83eb-949db2f8086d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:53.611411 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4871fc7a-d162-4761-83eb-949db2f8086d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:53.675696 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-4871fc7a-d162-4761-83eb-949db2f8086d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:53.684681 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4871fc7a-d162-4761-83eb-949db2f8086d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087430 Dec 15 16:50:53.685254 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1537/2870] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:53 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:54.702685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-cb627bae-4b75-4c0a-8843-03f9c23a790a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:54.703282 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-cb627bae-4b75-4c0a-8843-03f9c23a790a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:54.711662 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb627bae-4b75-4c0a-8843-03f9c23a790a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:54.712108 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb627bae-4b75-4c0a-8843-03f9c23a790a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:54.712928 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb627bae-4b75-4c0a-8843-03f9c23a790a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:54.713359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-cb627bae-4b75-4c0a-8843-03f9c23a790a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:54.776198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-cb627bae-4b75-4c0a-8843-03f9c23a790a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:54.784622 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-cb627bae-4b75-4c0a-8843-03f9c23a790a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086190 Dec 15 16:50:54.785184 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1334/2871] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:54 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:55.809552 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f6faa4cc-958a-4f77-b44a-82a64597a241 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:55.810315 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f6faa4cc-958a-4f77-b44a-82a64597a241 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:55.819521 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f6faa4cc-958a-4f77-b44a-82a64597a241 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:55.819970 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f6faa4cc-958a-4f77-b44a-82a64597a241 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:55.820784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f6faa4cc-958a-4f77-b44a-82a64597a241 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:55.821219 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f6faa4cc-958a-4f77-b44a-82a64597a241 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:55.890700 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f6faa4cc-958a-4f77-b44a-82a64597a241 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:55.899218 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f6faa4cc-958a-4f77-b44a-82a64597a241 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094718 Dec 15 16:50:55.899779 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1538/2872] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:55 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:56.920248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-67799cbe-e0d6-4507-b46f-a04dcbcfe604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:56.921281 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-67799cbe-e0d6-4507-b46f-a04dcbcfe604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:56.930331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67799cbe-e0d6-4507-b46f-a04dcbcfe604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:56.930793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67799cbe-e0d6-4507-b46f-a04dcbcfe604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:56.931559 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67799cbe-e0d6-4507-b46f-a04dcbcfe604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:56.931992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-67799cbe-e0d6-4507-b46f-a04dcbcfe604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:56.993632 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-67799cbe-e0d6-4507-b46f-a04dcbcfe604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:57.001649 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-67799cbe-e0d6-4507-b46f-a04dcbcfe604 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087564 Dec 15 16:50:57.002214 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1335/2873] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:56 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:58.023159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1f5b8b9d-2c54-4119-b66d-87b4c363d264 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:58.023792 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-1f5b8b9d-2c54-4119-b66d-87b4c363d264 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:58.030462 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f5b8b9d-2c54-4119-b66d-87b4c363d264 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:58.030904 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f5b8b9d-2c54-4119-b66d-87b4c363d264 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:58.031674 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f5b8b9d-2c54-4119-b66d-87b4c363d264 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:58.032104 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-1f5b8b9d-2c54-4119-b66d-87b4c363d264 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:58.095113 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-1f5b8b9d-2c54-4119-b66d-87b4c363d264 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:58.103668 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1f5b8b9d-2c54-4119-b66d-87b4c363d264 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.087009 Dec 15 16:50:58.104333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1539/2874] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:58 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:50:59.124883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-05103792-d2bf-4cf5-b955-a60ea7bf767a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:50:59.125984 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-05103792-d2bf-4cf5-b955-a60ea7bf767a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:50:59.135470 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05103792-d2bf-4cf5-b955-a60ea7bf767a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:59.135920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05103792-d2bf-4cf5-b955-a60ea7bf767a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:59.136762 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05103792-d2bf-4cf5-b955-a60ea7bf767a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:50:59.137196 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-05103792-d2bf-4cf5-b955-a60ea7bf767a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:50:59.206268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-05103792-d2bf-4cf5-b955-a60ea7bf767a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:50:59.216374 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-05103792-d2bf-4cf5-b955-a60ea7bf767a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.097707 Dec 15 16:50:59.216997 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1336/2875] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:50:59 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:00.237050 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b22e934d-a432-4b6c-9362-00439cfc83e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:00.238016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b22e934d-a432-4b6c-9362-00439cfc83e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:00.246201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b22e934d-a432-4b6c-9362-00439cfc83e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:00.246646 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b22e934d-a432-4b6c-9362-00439cfc83e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:00.247423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b22e934d-a432-4b6c-9362-00439cfc83e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:00.247852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b22e934d-a432-4b6c-9362-00439cfc83e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:00.329558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-b22e934d-a432-4b6c-9362-00439cfc83e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:00.341907 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b22e934d-a432-4b6c-9362-00439cfc83e8 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.111080 Dec 15 16:51:00.342637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1540/2876] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:00 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:01.363526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-15d07d87-a081-4be0-8212-73e419cdec06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:01.364266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-15d07d87-a081-4be0-8212-73e419cdec06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:01.372908 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-15d07d87-a081-4be0-8212-73e419cdec06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:01.373489 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-15d07d87-a081-4be0-8212-73e419cdec06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:01.374732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-15d07d87-a081-4be0-8212-73e419cdec06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:01.375389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-15d07d87-a081-4be0-8212-73e419cdec06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:01.444138 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-15d07d87-a081-4be0-8212-73e419cdec06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:01.453274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-15d07d87-a081-4be0-8212-73e419cdec06 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094668 Dec 15 16:51:01.453856 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1337/2877] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:01 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:02.474682 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f1b4140e-e805-45df-92ac-9e5cbc599295 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:02.475548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-f1b4140e-e805-45df-92ac-9e5cbc599295 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:02.486471 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f1b4140e-e805-45df-92ac-9e5cbc599295 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:02.487214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f1b4140e-e805-45df-92ac-9e5cbc599295 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:02.488525 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f1b4140e-e805-45df-92ac-9e5cbc599295 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:02.489257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-f1b4140e-e805-45df-92ac-9e5cbc599295 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:02.550911 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-f1b4140e-e805-45df-92ac-9e5cbc599295 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:02.559559 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f1b4140e-e805-45df-92ac-9e5cbc599295 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.091177 Dec 15 16:51:02.560122 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1541/2878] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:02 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:03.580575 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-ab67a24e-9d26-45e7-92b9-622a83ba005c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:03.581556 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-ab67a24e-9d26-45e7-92b9-622a83ba005c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:03.593113 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab67a24e-9d26-45e7-92b9-622a83ba005c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:03.593858 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab67a24e-9d26-45e7-92b9-622a83ba005c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:03.595155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab67a24e-9d26-45e7-92b9-622a83ba005c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:03.595891 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-ab67a24e-9d26-45e7-92b9-622a83ba005c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:03.659344 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-ab67a24e-9d26-45e7-92b9-622a83ba005c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:03.671682 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-ab67a24e-9d26-45e7-92b9-622a83ba005c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.096982 Dec 15 16:51:03.672464 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1338/2879] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:03 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:04.695030 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a2ce28f2-3b85-49c2-ab7b-8de9a1cad827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:04.696276 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a2ce28f2-3b85-49c2-ab7b-8de9a1cad827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:04.706156 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2ce28f2-3b85-49c2-ab7b-8de9a1cad827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:04.706898 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2ce28f2-3b85-49c2-ab7b-8de9a1cad827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:04.708167 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2ce28f2-3b85-49c2-ab7b-8de9a1cad827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:04.708922 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a2ce28f2-3b85-49c2-ab7b-8de9a1cad827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:04.776255 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a2ce28f2-3b85-49c2-ab7b-8de9a1cad827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:04.787752 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a2ce28f2-3b85-49c2-ab7b-8de9a1cad827 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.098805 Dec 15 16:51:04.788463 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1542/2880] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:04 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:05.809018 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-0c0797f0-b109-4492-974d-e309b32666d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:05.809970 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-0c0797f0-b109-4492-974d-e309b32666d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:05.820331 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c0797f0-b109-4492-974d-e309b32666d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:05.820806 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c0797f0-b109-4492-974d-e309b32666d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:05.821603 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c0797f0-b109-4492-974d-e309b32666d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:05.822029 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-0c0797f0-b109-4492-974d-e309b32666d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:05.881283 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-0c0797f0-b109-4492-974d-e309b32666d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:05.889516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-0c0797f0-b109-4492-974d-e309b32666d7 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.086916 Dec 15 16:51:05.890088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1339/2881] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:05 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:06.910524 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8fea4bc2-4ba1-43dc-9ff3-d9b2a6d07e1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:06.911532 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8fea4bc2-4ba1-43dc-9ff3-d9b2a6d07e1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:06.922043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fea4bc2-4ba1-43dc-9ff3-d9b2a6d07e1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:06.922773 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fea4bc2-4ba1-43dc-9ff3-d9b2a6d07e1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:06.924121 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fea4bc2-4ba1-43dc-9ff3-d9b2a6d07e1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:06.924871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8fea4bc2-4ba1-43dc-9ff3-d9b2a6d07e1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:06.990214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-8fea4bc2-4ba1-43dc-9ff3-d9b2a6d07e1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:06.998813 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8fea4bc2-4ba1-43dc-9ff3-d9b2a6d07e1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.094494 Dec 15 16:51:06.999389 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1543/2882] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:06 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:08.019125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7324b33b-825f-4ff1-a8ab-d8fc0bd23013 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:08.020061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7324b33b-825f-4ff1-a8ab-d8fc0bd23013 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:08.030850 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7324b33b-825f-4ff1-a8ab-d8fc0bd23013 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:08.031606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7324b33b-825f-4ff1-a8ab-d8fc0bd23013 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:08.032993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7324b33b-825f-4ff1-a8ab-d8fc0bd23013 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:08.033708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7324b33b-825f-4ff1-a8ab-d8fc0bd23013 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:08.099055 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7324b33b-825f-4ff1-a8ab-d8fc0bd23013 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:08.108098 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7324b33b-825f-4ff1-a8ab-d8fc0bd23013 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095245 Dec 15 16:51:08.108706 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1340/2883] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:08 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:09.128484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-64919ff5-385d-4945-80de-fe36687907d3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:09.129507 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-64919ff5-385d-4945-80de-fe36687907d3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:09.138360 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64919ff5-385d-4945-80de-fe36687907d3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:09.138809 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64919ff5-385d-4945-80de-fe36687907d3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:09.139591 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64919ff5-385d-4945-80de-fe36687907d3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:09.140020 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-64919ff5-385d-4945-80de-fe36687907d3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:09.208528 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-64919ff5-385d-4945-80de-fe36687907d3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:09.217706 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-64919ff5-385d-4945-80de-fe36687907d3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 200 len: 1369 microversion: 2.1 time: 0.095302 Dec 15 16:51:09.218267 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1544/2884] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:09 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:09.243038 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5546f005-0a7f-413f-9af5-a8b44122c30a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '.version_select at 0x7f3a7c1d58b0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:09.268769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5546f005-0a7f-413f-9af5-a8b44122c30a tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359795542" status: 202 len: 0 microversion: 2.1 time: 0.033217 Dec 15 16:51:09.269548 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1341/2885] 10.222.0.30 () {58 vars in 1220 bytes} [Wed Dec 15 16:51:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359795542 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:51:10.084422 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-f297847b-be8d-4d49-8d77-30d8efd1fbc2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'create', calling method: .version_select at 0x7f3a7c353310>, body: {"keypair": {"name": "tempest-keypair-1313486662"}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:10.100192 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-f297847b-be8d-4d49-8d77-30d8efd1fbc2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for project 9264b7d2b1b4444f848035561e48c126. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:51:10.105201 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-f297847b-be8d-4d49-8d77-30d8efd1fbc2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for user 5686da93293e439eaf999b67fc154b14 and project 9264b7d2b1b4444f848035561e48c126. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:51:10.317514 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-f297847b-be8d-4d49-8d77-30d8efd1fbc2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for project 9264b7d2b1b4444f848035561e48c126. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:51:10.321398 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.quota [None req-f297847b-be8d-4d49-8d77-30d8efd1fbc2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for user 5686da93293e439eaf999b67fc154b14 and project 9264b7d2b1b4444f848035561e48c126. Resources: {'key_pairs'} {{(pid=116021) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:51:10.333929 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-f297847b-be8d-4d49-8d77-30d8efd1fbc2 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.253349 Dec 15 16:51:10.334774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1545/2886] 10.222.0.30 () {60 vars in 1157 bytes} [Wed Dec 15 16:51:10 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:11.666125 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1038762193", "imageRef": "f1bc0b0f-9ba5-45ec-9585-5f05ae46981f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76827dcc-7b99-494c-b3aa-89beb62d532b"}], "security_groups": [{"name": "tempest-securitygroup--1343750718"}], "key_name": "tempest-keypair-1313486662", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:11.781857 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.network.neutron [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] validate_networks() for [('76827dcc-7b99-494c-b3aa-89beb62d532b', None, None, None, None, None)] {{(pid=116022) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:51:12.221144 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Flavor limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:51:12.221568 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Image limits 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:51:12.222030 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Flavor pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:51:12.222433 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Image pref 0:0:0 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:51:12.222836 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.virt.hardware [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:51:12.234989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:12.234989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:12.234989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:12.234989 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:12.252299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for project 9264b7d2b1b4444f848035561e48c126. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:51:12.256623 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.quota [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Getting quotas for user 5686da93293e439eaf999b67fc154b14 and project 9264b7d2b1b4444f848035561e48c126. Resources: {'cores', 'ram', 'instances'} {{(pid=116022) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:51:12.268207 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Going to run 1 instances... {{(pid=116022) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:51:12.270529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1bc0b0f-9ba5-45ec-9585-5f05ae46981f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:51:12.314332 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: ERROR oslo.messaging._drivers.impl_rabbit [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [252aaa8b-4837-47a6-996f-ebdea3cfd3b7] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 16:51:13.341980 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [252aaa8b-4837-47a6-996f-ebdea3cfd3b7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 51210. Dec 15 16:51:13.348216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-35dc3a46-ed26-49e3-b657-3f51013169c9 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.686642 Dec 15 16:51:13.349143 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1342/2887] 10.222.0.30 () {60 vars in 1146 bytes} [Wed Dec 15 16:51:11 2021] POST /compute/v2.1/servers => generated 402 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:51:13.363950 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3412643a-79e4-4dee-8331-e4d493fa8816 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:13.365652 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3412643a-79e4-4dee-8331-e4d493fa8816 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:13.428930 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-3412643a-79e4-4dee-8331-e4d493fa8816 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:13.440736 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3412643a-79e4-4dee-8331-e4d493fa8816 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1238 microversion: 2.1 time: 0.081675 Dec 15 16:51:13.441529 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1546/2888] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:13 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:14.459431 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa8913c7-f738-4b14-99e9-f41cbe26b042 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:14.460711 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa8913c7-f738-4b14-99e9-f41cbe26b042 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:14.516339 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-aa8913c7-f738-4b14-99e9-f41cbe26b042 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:14.523253 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa8913c7-f738-4b14-99e9-f41cbe26b042 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1238 microversion: 2.1 time: 0.067950 Dec 15 16:51:14.523817 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1343/2889] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:14 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:15.545353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6b17f6bf-c37d-48ec-b21a-1eb74d5572d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:15.546244 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6b17f6bf-c37d-48ec-b21a-1eb74d5572d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:15.602001 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6b17f6bf-c37d-48ec-b21a-1eb74d5572d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:15.609973 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6b17f6bf-c37d-48ec-b21a-1eb74d5572d5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1238 microversion: 2.1 time: 0.071792 Dec 15 16:51:15.610550 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1547/2890] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:15 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:16.629909 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1228231d-b054-4d7f-aa44-9c4eb37bd9da tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:16.630533 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1228231d-b054-4d7f-aa44-9c4eb37bd9da tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:16.637299 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1228231d-b054-4d7f-aa44-9c4eb37bd9da tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:16.637752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1228231d-b054-4d7f-aa44-9c4eb37bd9da tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:16.638529 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1228231d-b054-4d7f-aa44-9c4eb37bd9da tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:16.638964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1228231d-b054-4d7f-aa44-9c4eb37bd9da tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:16.735550 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-1228231d-b054-4d7f-aa44-9c4eb37bd9da tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:16.740516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1228231d-b054-4d7f-aa44-9c4eb37bd9da tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1296 microversion: 2.1 time: 0.114353 Dec 15 16:51:16.741087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1344/2891] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:16 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1296 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:17.759616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-a4088ef7-68bb-46e7-a6fb-29522fd5aeb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:17.760265 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-a4088ef7-68bb-46e7-a6fb-29522fd5aeb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:17.769294 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a4088ef7-68bb-46e7-a6fb-29522fd5aeb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:17.770503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a4088ef7-68bb-46e7-a6fb-29522fd5aeb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:17.771490 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a4088ef7-68bb-46e7-a6fb-29522fd5aeb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:17.772548 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-a4088ef7-68bb-46e7-a6fb-29522fd5aeb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:17.837036 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-aa6a1845-5863-49d1-84ac-bbf67a89ce22 req-70b26d5e-03d1-421d-83b0-23299c9c698f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6011fbb4-f50b-4f38-8125-0dcb7504d764", "tag": "63970b4f-a92c-446f-9d02-3a2c0d7f63e3"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:17.840065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:51:17.840065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:51:17.847993 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-aa6a1845-5863-49d1-84ac-bbf67a89ce22 req-70b26d5e-03d1-421d-83b0-23299c9c698f service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:17.848456 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-aa6a1845-5863-49d1-84ac-bbf67a89ce22 req-70b26d5e-03d1-421d-83b0-23299c9c698f service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:17.859931 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-aa6a1845-5863-49d1-84ac-bbf67a89ce22 req-70b26d5e-03d1-421d-83b0-23299c9c698f service nova] Creating event network-changed:63970b4f-a92c-446f-9d02-3a2c0d7f63e3 for instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 on hv-cinder-82002 Dec 15 16:51:17.866388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-aa6a1845-5863-49d1-84ac-bbf67a89ce22 req-70b26d5e-03d1-421d-83b0-23299c9c698f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099294 Dec 15 16:51:17.868715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1345/2892] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:51:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:51:18.012910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-a4088ef7-68bb-46e7-a6fb-29522fd5aeb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:18.020637 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-a4088ef7-68bb-46e7-a6fb-29522fd5aeb3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1364 microversion: 2.1 time: 0.266499 Dec 15 16:51:18.021212 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1548/2893] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:17 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:19.042486 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7d482abf-78bd-4aa7-bb85-a956bb2762f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:19.043067 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7d482abf-78bd-4aa7-bb85-a956bb2762f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:19.050526 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d482abf-78bd-4aa7-bb85-a956bb2762f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:19.050977 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d482abf-78bd-4aa7-bb85-a956bb2762f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:19.051894 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d482abf-78bd-4aa7-bb85-a956bb2762f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:19.052351 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d482abf-78bd-4aa7-bb85-a956bb2762f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:19.197923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-7d482abf-78bd-4aa7-bb85-a956bb2762f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:19.206612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7d482abf-78bd-4aa7-bb85-a956bb2762f3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1364 microversion: 2.1 time: 0.171043 Dec 15 16:51:19.207212 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1346/2894] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:19 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:20.228134 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-df1b4fa5-99c1-4467-87bc-b689db93492f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:20.229108 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-df1b4fa5-99c1-4467-87bc-b689db93492f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:20.236647 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df1b4fa5-99c1-4467-87bc-b689db93492f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:20.237139 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df1b4fa5-99c1-4467-87bc-b689db93492f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:20.238002 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df1b4fa5-99c1-4467-87bc-b689db93492f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:20.238478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-df1b4fa5-99c1-4467-87bc-b689db93492f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:20.379401 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-df1b4fa5-99c1-4467-87bc-b689db93492f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:20.388899 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-df1b4fa5-99c1-4467-87bc-b689db93492f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1364 microversion: 2.1 time: 0.166818 Dec 15 16:51:20.389475 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1549/2895] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:20 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:21.410558 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-e5f6e4e7-6f21-45e7-a7a7-ac911f049794 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:21.411502 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-e5f6e4e7-6f21-45e7-a7a7-ac911f049794 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:21.422698 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e5f6e4e7-6f21-45e7-a7a7-ac911f049794 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:21.423436 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e5f6e4e7-6f21-45e7-a7a7-ac911f049794 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:21.424770 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e5f6e4e7-6f21-45e7-a7a7-ac911f049794 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:21.425484 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-e5f6e4e7-6f21-45e7-a7a7-ac911f049794 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:21.821629 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-e5f6e4e7-6f21-45e7-a7a7-ac911f049794 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:21.830248 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-e5f6e4e7-6f21-45e7-a7a7-ac911f049794 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1364 microversion: 2.1 time: 0.425933 Dec 15 16:51:21.830812 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1347/2896] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:21 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1364 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:22.850709 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-57dbb3d9-c45c-4775-bd89-e854652390e5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:22.851758 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-57dbb3d9-c45c-4775-bd89-e854652390e5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:22.861508 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57dbb3d9-c45c-4775-bd89-e854652390e5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:22.862159 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57dbb3d9-c45c-4775-bd89-e854652390e5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:22.863366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57dbb3d9-c45c-4775-bd89-e854652390e5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:22.864016 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-57dbb3d9-c45c-4775-bd89-e854652390e5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:23.009353 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-57dbb3d9-c45c-4775-bd89-e854652390e5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:23.020278 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-57dbb3d9-c45c-4775-bd89-e854652390e5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1364 microversion: 2.1 time: 0.175579 Dec 15 16:51:23.020976 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1550/2897] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:22 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:24.038020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b5d4d56b-bc51-486e-acdf-4e4dd2856618 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:24.038677 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b5d4d56b-bc51-486e-acdf-4e4dd2856618 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:24.045563 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5d4d56b-bc51-486e-acdf-4e4dd2856618 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:24.046006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5d4d56b-bc51-486e-acdf-4e4dd2856618 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:24.046786 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5d4d56b-bc51-486e-acdf-4e4dd2856618 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:24.047216 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b5d4d56b-bc51-486e-acdf-4e4dd2856618 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:24.190890 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-b5d4d56b-bc51-486e-acdf-4e4dd2856618 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:24.202286 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b5d4d56b-bc51-486e-acdf-4e4dd2856618 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1364 microversion: 2.1 time: 0.168015 Dec 15 16:51:24.203105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1348/2898] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:24 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:24.452797 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-7dcde6bd-aaa8-42e6-a83e-eca22bfb4d0f req-a2f757a3-a1b6-4654-a224-a97b4cd1a0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6011fbb4-f50b-4f38-8125-0dcb7504d764", "name": "network-vif-plugged", "status": "completed", "tag": "63970b4f-a92c-446f-9d02-3a2c0d7f63e3"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:24.454372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:51:24.454372 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:51:24.461484 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-7dcde6bd-aaa8-42e6-a83e-eca22bfb4d0f req-a2f757a3-a1b6-4654-a224-a97b4cd1a0a4 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:24.461948 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-7dcde6bd-aaa8-42e6-a83e-eca22bfb4d0f req-a2f757a3-a1b6-4654-a224-a97b4cd1a0a4 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:24.474369 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-7dcde6bd-aaa8-42e6-a83e-eca22bfb4d0f req-a2f757a3-a1b6-4654-a224-a97b4cd1a0a4 service nova] Creating event network-vif-plugged:63970b4f-a92c-446f-9d02-3a2c0d7f63e3 for instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 on hv-cinder-82002 Dec 15 16:51:24.480467 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-7dcde6bd-aaa8-42e6-a83e-eca22bfb4d0f req-a2f757a3-a1b6-4654-a224-a97b4cd1a0a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082875 Dec 15 16:51:24.481364 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1551/2899] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:51:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:51:25.221062 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-08c7c0f7-8f33-4430-bb61-f536df56b4a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:25.221763 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-08c7c0f7-8f33-4430-bb61-f536df56b4a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:25.228788 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08c7c0f7-8f33-4430-bb61-f536df56b4a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:25.229224 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08c7c0f7-8f33-4430-bb61-f536df56b4a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:25.230084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08c7c0f7-8f33-4430-bb61-f536df56b4a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:25.230631 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-08c7c0f7-8f33-4430-bb61-f536df56b4a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:25.370524 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-08c7c0f7-8f33-4430-bb61-f536df56b4a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:25.378302 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-08c7c0f7-8f33-4430-bb61-f536df56b4a5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1364 microversion: 2.1 time: 0.161071 Dec 15 16:51:25.378802 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1349/2900] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:25 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:26.398345 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2655aa86-0ab0-4a66-b70b-65f2b4dce6e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:26.399041 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-2655aa86-0ab0-4a66-b70b-65f2b4dce6e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:26.405785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2655aa86-0ab0-4a66-b70b-65f2b4dce6e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:26.406226 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2655aa86-0ab0-4a66-b70b-65f2b4dce6e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:26.406999 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2655aa86-0ab0-4a66-b70b-65f2b4dce6e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:26.407429 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-2655aa86-0ab0-4a66-b70b-65f2b4dce6e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:26.560230 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-2655aa86-0ab0-4a66-b70b-65f2b4dce6e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:51:26.568424 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2655aa86-0ab0-4a66-b70b-65f2b4dce6e1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1550 microversion: 2.1 time: 0.174531 Dec 15 16:51:26.569035 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1552/2901] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:51:26 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:26.587833 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-c6c6121d-a8ae-49f3-8275-c46dce1904f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:51:26.588389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-c6c6121d-a8ae-49f3-8275-c46dce1904f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:26.596327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c6c6121d-a8ae-49f3-8275-c46dce1904f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:26.596804 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c6c6121d-a8ae-49f3-8275-c46dce1904f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:26.597591 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c6c6121d-a8ae-49f3-8275-c46dce1904f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:26.598027 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-c6c6121d-a8ae-49f3-8275-c46dce1904f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:26.687422 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-c6c6121d-a8ae-49f3-8275-c46dce1904f5 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105179 Dec 15 16:51:26.688238 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1350/2902] 10.222.0.30 () {58 vars in 1274 bytes} [Wed Dec 15 16:51:26 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:51:27.683257 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0d291296-c0cf-4307-9014-80f47dcfc6ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:27.689313 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-2d9f04d9-b5bf-4a00-9c5c-e3524a9edf0b req-11be4099-c019-48e9-9854-0ecaf22cd216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6011fbb4-f50b-4f38-8125-0dcb7504d764", "tag": "63970b4f-a92c-446f-9d02-3a2c0d7f63e3"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:27.690845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:51:27.690845 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:51:27.693402 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0d291296-c0cf-4307-9014-80f47dcfc6ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:27.698362 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-2d9f04d9-b5bf-4a00-9c5c-e3524a9edf0b req-11be4099-c019-48e9-9854-0ecaf22cd216 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:27.699006 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-2d9f04d9-b5bf-4a00-9c5c-e3524a9edf0b req-11be4099-c019-48e9-9854-0ecaf22cd216 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:27.700799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d291296-c0cf-4307-9014-80f47dcfc6ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:27.701496 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d291296-c0cf-4307-9014-80f47dcfc6ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:27.702277 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d291296-c0cf-4307-9014-80f47dcfc6ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:27.702895 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0d291296-c0cf-4307-9014-80f47dcfc6ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:27.711280 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-2d9f04d9-b5bf-4a00-9c5c-e3524a9edf0b req-11be4099-c019-48e9-9854-0ecaf22cd216 service nova] Creating event network-changed:63970b4f-a92c-446f-9d02-3a2c0d7f63e3 for instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 on hv-cinder-82002 Dec 15 16:51:27.717868 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-2d9f04d9-b5bf-4a00-9c5c-e3524a9edf0b req-11be4099-c019-48e9-9854-0ecaf22cd216 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032410 Dec 15 16:51:27.719174 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1351/2903] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:51:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:51:27.763313 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0d291296-c0cf-4307-9014-80f47dcfc6ff tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14 microversion: 2.1 time: 0.083797 Dec 15 16:51:27.764296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1553/2904] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:27 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:51:28.775774 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-dbddbd79-bd51-4f5e-b79c-44d78051ad75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:28.776781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-dbddbd79-bd51-4f5e-b79c-44d78051ad75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:28.783764 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dbddbd79-bd51-4f5e-b79c-44d78051ad75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:28.784199 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dbddbd79-bd51-4f5e-b79c-44d78051ad75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:28.785007 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dbddbd79-bd51-4f5e-b79c-44d78051ad75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:28.785435 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-dbddbd79-bd51-4f5e-b79c-44d78051ad75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:28.843727 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-dbddbd79-bd51-4f5e-b79c-44d78051ad75 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14 microversion: 2.1 time: 0.072268 Dec 15 16:51:28.844592 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1352/2905] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:28 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:51:29.856102 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-e9068507-9a45-4084-bb10-920e33b35b8c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:29.857197 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-e9068507-9a45-4084-bb10-920e33b35b8c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:29.864622 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9068507-9a45-4084-bb10-920e33b35b8c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:29.865067 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9068507-9a45-4084-bb10-920e33b35b8c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:29.865851 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9068507-9a45-4084-bb10-920e33b35b8c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:29.866283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-e9068507-9a45-4084-bb10-920e33b35b8c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:29.929190 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-e9068507-9a45-4084-bb10-920e33b35b8c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14 microversion: 2.1 time: 0.076864 Dec 15 16:51:29.929910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1554/2906] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:29 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:51:30.947057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-64f11775-3f8f-408a-b4dc-4474a65cb7ca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:30.948582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-64f11775-3f8f-408a-b4dc-4474a65cb7ca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:30.960083 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64f11775-3f8f-408a-b4dc-4474a65cb7ca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:30.960884 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64f11775-3f8f-408a-b4dc-4474a65cb7ca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:30.962154 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64f11775-3f8f-408a-b4dc-4474a65cb7ca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:30.962873 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-64f11775-3f8f-408a-b4dc-4474a65cb7ca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:31.021206 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-64f11775-3f8f-408a-b4dc-4474a65cb7ca tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14 microversion: 2.1 time: 0.080965 Dec 15 16:51:31.021822 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1353/2907] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:30 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:51:32.033590 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d09490de-3546-4604-bb35-eb84323046ce tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:32.034579 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-d09490de-3546-4604-bb35-eb84323046ce tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:32.041785 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d09490de-3546-4604-bb35-eb84323046ce tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:32.042240 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d09490de-3546-4604-bb35-eb84323046ce tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:32.043025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d09490de-3546-4604-bb35-eb84323046ce tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:32.043557 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-d09490de-3546-4604-bb35-eb84323046ce tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:32.102151 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d09490de-3546-4604-bb35-eb84323046ce tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14 microversion: 2.1 time: 0.072477 Dec 15 16:51:32.102780 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1555/2908] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:32 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:51:33.118242 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6cd1123a-34d9-4033-8e68-e909982ec66b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:33.119842 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6cd1123a-34d9-4033-8e68-e909982ec66b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:33.128187 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6cd1123a-34d9-4033-8e68-e909982ec66b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:33.128683 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6cd1123a-34d9-4033-8e68-e909982ec66b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:33.129460 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6cd1123a-34d9-4033-8e68-e909982ec66b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:33.129888 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6cd1123a-34d9-4033-8e68-e909982ec66b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:33.186889 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6cd1123a-34d9-4033-8e68-e909982ec66b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14 microversion: 2.1 time: 0.075159 Dec 15 16:51:33.187561 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1354/2909] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:33 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:51:34.200831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5076d598-5f2b-412c-b499-dd3ee4159902 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:34.202199 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5076d598-5f2b-412c-b499-dd3ee4159902 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:34.211857 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5076d598-5f2b-412c-b499-dd3ee4159902 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:34.212503 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5076d598-5f2b-412c-b499-dd3ee4159902 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:34.213623 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5076d598-5f2b-412c-b499-dd3ee4159902 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:34.214604 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5076d598-5f2b-412c-b499-dd3ee4159902 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:34.273755 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5076d598-5f2b-412c-b499-dd3ee4159902 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14 microversion: 2.1 time: 0.078252 Dec 15 16:51:34.274518 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1556/2910] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:34 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:51:35.290234 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-829396ef-3563-431f-93ff-416bd40f41fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:35.291814 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-829396ef-3563-431f-93ff-416bd40f41fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:35.300099 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-829396ef-3563-431f-93ff-416bd40f41fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:35.300587 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-829396ef-3563-431f-93ff-416bd40f41fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:35.301369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-829396ef-3563-431f-93ff-416bd40f41fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:35.301800 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-829396ef-3563-431f-93ff-416bd40f41fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:35.365180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-829396ef-3563-431f-93ff-416bd40f41fa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14 microversion: 2.1 time: 0.081768 Dec 15 16:51:35.365837 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1355/2911] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:35 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:51:36.381237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-0060e187-315e-4c0c-aad9-3a03af964ebc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:36.382843 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-0060e187-315e-4c0c-aad9-3a03af964ebc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:36.394359 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0060e187-315e-4c0c-aad9-3a03af964ebc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:36.395098 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0060e187-315e-4c0c-aad9-3a03af964ebc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:36.396378 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0060e187-315e-4c0c-aad9-3a03af964ebc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:36.397145 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-0060e187-315e-4c0c-aad9-3a03af964ebc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:36.460474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-0060e187-315e-4c0c-aad9-3a03af964ebc tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14 microversion: 2.1 time: 0.086013 Dec 15 16:51:36.461126 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1557/2912] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:36 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:51:37.476964 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-db136d53-4d48-4c27-9a15-525e716bbf1d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:37.478455 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-db136d53-4d48-4c27-9a15-525e716bbf1d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:37.487330 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db136d53-4d48-4c27-9a15-525e716bbf1d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:37.487781 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db136d53-4d48-4c27-9a15-525e716bbf1d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:37.488598 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db136d53-4d48-4c27-9a15-525e716bbf1d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:37.489044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-db136d53-4d48-4c27-9a15-525e716bbf1d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:37.562180 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-db136d53-4d48-4c27-9a15-525e716bbf1d tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 1106 microversion: 2.1 time: 0.092118 Dec 15 16:51:37.562796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1356/2913] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:37 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 1106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:51:38.578731 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b6b10a8b-fc79-4d14-8ce1-852a319c6b0b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:38.580367 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b6b10a8b-fc79-4d14-8ce1-852a319c6b0b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:38.592296 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6b10a8b-fc79-4d14-8ce1-852a319c6b0b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:38.592804 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6b10a8b-fc79-4d14-8ce1-852a319c6b0b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:38.593607 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6b10a8b-fc79-4d14-8ce1-852a319c6b0b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:38.594031 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b6b10a8b-fc79-4d14-8ce1-852a319c6b0b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:38.663789 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b6b10a8b-fc79-4d14-8ce1-852a319c6b0b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 14631 microversion: 2.1 time: 0.092356 Dec 15 16:51:38.664461 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1558/2914] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:38 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 14631 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:39.678273 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-d4291686-a6f7-45d1-8543-fad97219a769 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:39.679490 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-d4291686-a6f7-45d1-8543-fad97219a769 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:39.688388 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4291686-a6f7-45d1-8543-fad97219a769 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:39.688983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4291686-a6f7-45d1-8543-fad97219a769 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:39.689951 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4291686-a6f7-45d1-8543-fad97219a769 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:39.690487 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-d4291686-a6f7-45d1-8543-fad97219a769 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:39.768773 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-d4291686-a6f7-45d1-8543-fad97219a769 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 18608 microversion: 2.1 time: 0.095088 Dec 15 16:51:39.769713 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1357/2915] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:39 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 18608 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:40.785158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-43b73adc-f5a4-4f1a-ac1e-068793f6bd6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:40.786158 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-43b73adc-f5a4-4f1a-ac1e-068793f6bd6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:40.794136 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43b73adc-f5a4-4f1a-ac1e-068793f6bd6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:40.794920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43b73adc-f5a4-4f1a-ac1e-068793f6bd6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:40.796013 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43b73adc-f5a4-4f1a-ac1e-068793f6bd6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:40.796689 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-43b73adc-f5a4-4f1a-ac1e-068793f6bd6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:40.878786 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-43b73adc-f5a4-4f1a-ac1e-068793f6bd6b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 19342 microversion: 2.1 time: 0.098101 Dec 15 16:51:40.879448 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1559/2916] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:40 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 19342 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:41.894735 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-634bbb6c-6206-459b-af33-05e750c258cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:41.896345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-634bbb6c-6206-459b-af33-05e750c258cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:41.908182 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-634bbb6c-6206-459b-af33-05e750c258cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:41.908973 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-634bbb6c-6206-459b-af33-05e750c258cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:41.910240 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-634bbb6c-6206-459b-af33-05e750c258cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:41.910959 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-634bbb6c-6206-459b-af33-05e750c258cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:41.989907 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-634bbb6c-6206-459b-af33-05e750c258cb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 22168 microversion: 2.1 time: 0.101726 Dec 15 16:51:41.990741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1358/2917] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:41 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 22168 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:43.004477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-73379b77-7576-4181-bee4-42235eeda83c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:43.005644 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-73379b77-7576-4181-bee4-42235eeda83c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:43.015694 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73379b77-7576-4181-bee4-42235eeda83c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:43.016404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73379b77-7576-4181-bee4-42235eeda83c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:43.017624 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73379b77-7576-4181-bee4-42235eeda83c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:43.018253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-73379b77-7576-4181-bee4-42235eeda83c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:43.092304 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-73379b77-7576-4181-bee4-42235eeda83c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 23804 microversion: 2.1 time: 0.092238 Dec 15 16:51:43.093052 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1560/2918] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:42 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 23804 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:44.106120 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-1369e106-e570-46bd-9689-e52190e12c0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:44.107444 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-1369e106-e570-46bd-9689-e52190e12c0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:44.115305 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1369e106-e570-46bd-9689-e52190e12c0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:44.115749 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1369e106-e570-46bd-9689-e52190e12c0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:44.116663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1369e106-e570-46bd-9689-e52190e12c0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:44.117111 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-1369e106-e570-46bd-9689-e52190e12c0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:44.188511 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-1369e106-e570-46bd-9689-e52190e12c0c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 25243 microversion: 2.1 time: 0.087479 Dec 15 16:51:44.189177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1359/2919] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:44 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 25243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:45.202931 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b9ee432f-feec-461e-846d-a1f3b4478f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:45.204088 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b9ee432f-feec-461e-846d-a1f3b4478f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:45.213148 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9ee432f-feec-461e-846d-a1f3b4478f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:45.213703 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9ee432f-feec-461e-846d-a1f3b4478f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:45.215043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9ee432f-feec-461e-846d-a1f3b4478f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:45.215580 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b9ee432f-feec-461e-846d-a1f3b4478f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:45.294690 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b9ee432f-feec-461e-846d-a1f3b4478f44 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 26827 microversion: 2.1 time: 0.096385 Dec 15 16:51:45.295713 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1561/2920] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:45 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 26827 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:46.315086 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-54ceb303-f281-4ff8-9c94-eca2d39bf038 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:46.316751 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-54ceb303-f281-4ff8-9c94-eca2d39bf038 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:46.328213 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-54ceb303-f281-4ff8-9c94-eca2d39bf038 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:46.328793 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-54ceb303-f281-4ff8-9c94-eca2d39bf038 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:46.329582 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-54ceb303-f281-4ff8-9c94-eca2d39bf038 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:46.330015 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-54ceb303-f281-4ff8-9c94-eca2d39bf038 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:46.405034 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-54ceb303-f281-4ff8-9c94-eca2d39bf038 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 27722 microversion: 2.1 time: 0.096569 Dec 15 16:51:46.405752 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1360/2921] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:46 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 27722 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:47.422249 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-b4eb406f-9279-4d09-99c6-f9cf89341071 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:47.423702 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-b4eb406f-9279-4d09-99c6-f9cf89341071 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:47.435172 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b4eb406f-9279-4d09-99c6-f9cf89341071 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:47.435910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b4eb406f-9279-4d09-99c6-f9cf89341071 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:47.437341 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b4eb406f-9279-4d09-99c6-f9cf89341071 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:47.437774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-b4eb406f-9279-4d09-99c6-f9cf89341071 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:47.513248 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-b4eb406f-9279-4d09-99c6-f9cf89341071 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 28202 microversion: 2.1 time: 0.097624 Dec 15 16:51:47.513902 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1562/2922] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:47 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 28202 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:48.532306 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3024ab26-6584-41ea-9ffe-7e6fcfa6c5c3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:48.534229 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-3024ab26-6584-41ea-9ffe-7e6fcfa6c5c3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:48.548417 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3024ab26-6584-41ea-9ffe-7e6fcfa6c5c3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:48.549479 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3024ab26-6584-41ea-9ffe-7e6fcfa6c5c3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:48.549871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3024ab26-6584-41ea-9ffe-7e6fcfa6c5c3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:48.550680 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-3024ab26-6584-41ea-9ffe-7e6fcfa6c5c3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:48.614359 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3024ab26-6584-41ea-9ffe-7e6fcfa6c5c3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 28202 microversion: 2.1 time: 0.089004 Dec 15 16:51:48.614994 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1361/2923] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:48 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 28202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:49.628380 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-987f1df7-0b66-4a8a-8a05-f7c6ce783abe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:49.629613 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-987f1df7-0b66-4a8a-8a05-f7c6ce783abe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:49.637984 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-987f1df7-0b66-4a8a-8a05-f7c6ce783abe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:49.638535 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-987f1df7-0b66-4a8a-8a05-f7c6ce783abe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:49.639456 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-987f1df7-0b66-4a8a-8a05-f7c6ce783abe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:49.639972 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-987f1df7-0b66-4a8a-8a05-f7c6ce783abe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:49.718256 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-987f1df7-0b66-4a8a-8a05-f7c6ce783abe tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 28493 microversion: 2.1 time: 0.094695 Dec 15 16:51:49.718924 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1563/2924] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:49 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 28493 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:50.737205 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-07aa2063-ad86-4725-a45a-4d13da19623f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:50.738109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-07aa2063-ad86-4725-a45a-4d13da19623f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:50.745606 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-07aa2063-ad86-4725-a45a-4d13da19623f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:50.746052 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-07aa2063-ad86-4725-a45a-4d13da19623f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:50.746834 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-07aa2063-ad86-4725-a45a-4d13da19623f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:50.747274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-07aa2063-ad86-4725-a45a-4d13da19623f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:50.822353 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-07aa2063-ad86-4725-a45a-4d13da19623f tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 28661 microversion: 2.1 time: 0.091803 Dec 15 16:51:50.822975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1362/2925] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:50 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 28661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:51.840071 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-989d1a04-bbc8-4305-b5a5-097fa27015ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:51.841721 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-989d1a04-bbc8-4305-b5a5-097fa27015ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:51.851176 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-989d1a04-bbc8-4305-b5a5-097fa27015ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:51.851628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-989d1a04-bbc8-4305-b5a5-097fa27015ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:51.852413 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-989d1a04-bbc8-4305-b5a5-097fa27015ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:51.852881 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-989d1a04-bbc8-4305-b5a5-097fa27015ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:51.915232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-989d1a04-bbc8-4305-b5a5-097fa27015ed tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 28661 microversion: 2.1 time: 0.082014 Dec 15 16:51:51.916144 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1564/2926] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:51 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 28661 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:52.931685 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-5ab3dec1-62d2-4715-b104-e908d4259954 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:52.933338 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-5ab3dec1-62d2-4715-b104-e908d4259954 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:52.943260 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ab3dec1-62d2-4715-b104-e908d4259954 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:52.943709 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ab3dec1-62d2-4715-b104-e908d4259954 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:52.944507 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ab3dec1-62d2-4715-b104-e908d4259954 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:52.944963 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-5ab3dec1-62d2-4715-b104-e908d4259954 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:53.010532 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-5ab3dec1-62d2-4715-b104-e908d4259954 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 28661 microversion: 2.1 time: 0.085538 Dec 15 16:51:53.011192 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1363/2927] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:52 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 28661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:54.024784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-5bac1a1f-e321-4be1-abec-944d52f593b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:54.025774 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-5bac1a1f-e321-4be1-abec-944d52f593b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:54.032784 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5bac1a1f-e321-4be1-abec-944d52f593b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:54.033228 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5bac1a1f-e321-4be1-abec-944d52f593b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:54.034000 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5bac1a1f-e321-4be1-abec-944d52f593b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:54.034428 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-5bac1a1f-e321-4be1-abec-944d52f593b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:54.107440 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-5bac1a1f-e321-4be1-abec-944d52f593b0 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 28815 microversion: 2.1 time: 0.086631 Dec 15 16:51:54.108070 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1565/2928] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:54 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 28815 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:55.123917 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-aa9a17e0-9295-415c-83ac-6c8b487f3c1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:55.125586 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-aa9a17e0-9295-415c-83ac-6c8b487f3c1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:55.134372 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa9a17e0-9295-415c-83ac-6c8b487f3c1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:55.134819 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa9a17e0-9295-415c-83ac-6c8b487f3c1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:55.135612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa9a17e0-9295-415c-83ac-6c8b487f3c1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:55.136044 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-aa9a17e0-9295-415c-83ac-6c8b487f3c1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:55.215446 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-aa9a17e0-9295-415c-83ac-6c8b487f3c1c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 31119 microversion: 2.1 time: 0.098444 Dec 15 16:51:55.216088 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1364/2929] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:55 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 31119 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:56.228834 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-8e5fad0c-c5ce-4da3-85b2-1b5528e1277c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:56.229858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-8e5fad0c-c5ce-4da3-85b2-1b5528e1277c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:56.240064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8e5fad0c-c5ce-4da3-85b2-1b5528e1277c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:56.240825 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8e5fad0c-c5ce-4da3-85b2-1b5528e1277c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:56.241701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8e5fad0c-c5ce-4da3-85b2-1b5528e1277c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:56.242141 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-8e5fad0c-c5ce-4da3-85b2-1b5528e1277c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:56.318025 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-8e5fad0c-c5ce-4da3-85b2-1b5528e1277c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 33028 microversion: 2.1 time: 0.093481 Dec 15 16:51:56.318673 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1566/2930] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:56 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 33028 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:57.334077 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-acbf98e1-f19e-4de9-bd49-a49d880d122e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:57.335065 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-acbf98e1-f19e-4de9-bd49-a49d880d122e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:57.342611 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-acbf98e1-f19e-4de9-bd49-a49d880d122e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:57.343059 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-acbf98e1-f19e-4de9-bd49-a49d880d122e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:57.343835 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-acbf98e1-f19e-4de9-bd49-a49d880d122e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:57.344264 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-acbf98e1-f19e-4de9-bd49-a49d880d122e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:57.421316 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-acbf98e1-f19e-4de9-bd49-a49d880d122e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 34024 microversion: 2.1 time: 0.092555 Dec 15 16:51:57.422035 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1365/2931] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:57 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 34024 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:58.435187 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-86715a1c-f787-4665-90d8-78cbea67584c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:58.436213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-86715a1c-f787-4665-90d8-78cbea67584c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:58.443769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86715a1c-f787-4665-90d8-78cbea67584c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:58.444214 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86715a1c-f787-4665-90d8-78cbea67584c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:58.445051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86715a1c-f787-4665-90d8-78cbea67584c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:58.445478 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-86715a1c-f787-4665-90d8-78cbea67584c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:58.516009 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-86715a1c-f787-4665-90d8-78cbea67584c tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 35235 microversion: 2.1 time: 0.084820 Dec 15 16:51:58.516677 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1567/2932] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:58 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 35235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:51:59.534023 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2f821a6c-92c9-47f2-b1a5-52b9e97f1125 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:51:59.535104 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2f821a6c-92c9-47f2-b1a5-52b9e97f1125 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:51:59.542731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f821a6c-92c9-47f2-b1a5-52b9e97f1125 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:59.543177 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f821a6c-92c9-47f2-b1a5-52b9e97f1125 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:59.543958 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f821a6c-92c9-47f2-b1a5-52b9e97f1125 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:51:59.544384 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2f821a6c-92c9-47f2-b1a5-52b9e97f1125 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:51:59.620670 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2f821a6c-92c9-47f2-b1a5-52b9e97f1125 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 36746 microversion: 2.1 time: 0.093432 Dec 15 16:51:59.621674 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1366/2933] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:51:59 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 36746 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:52:00.641802 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6f389f85-0aac-4b03-9f91-ce53b8905adf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:52:00.642716 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6f389f85-0aac-4b03-9f91-ce53b8905adf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:52:00.650231 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f389f85-0aac-4b03-9f91-ce53b8905adf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:00.650680 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f389f85-0aac-4b03-9f91-ce53b8905adf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:00.651474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f389f85-0aac-4b03-9f91-ce53b8905adf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:00.651913 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6f389f85-0aac-4b03-9f91-ce53b8905adf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:00.725748 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6f389f85-0aac-4b03-9f91-ce53b8905adf tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 38186 microversion: 2.1 time: 0.091965 Dec 15 16:52:00.726442 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1568/2934] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:52:00 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 38186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:52:01.741070 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-2da722fa-97ad-4c82-ad43-8e1c4d36b325 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:52:01.742072 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-2da722fa-97ad-4c82-ad43-8e1c4d36b325 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:52:01.749369 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2da722fa-97ad-4c82-ad43-8e1c4d36b325 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:01.749823 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2da722fa-97ad-4c82-ad43-8e1c4d36b325 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:01.750619 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2da722fa-97ad-4c82-ad43-8e1c4d36b325 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:01.751057 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-2da722fa-97ad-4c82-ad43-8e1c4d36b325 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:01.811874 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-2da722fa-97ad-4c82-ad43-8e1c4d36b325 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 38186 microversion: 2.1 time: 0.076637 Dec 15 16:52:01.812531 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1367/2935] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:52:01 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 38186 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:52:02.830371 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-3e090294-8c46-4038-a935-1eca729b6956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:52:02.831627 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-3e090294-8c46-4038-a935-1eca729b6956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:52:02.843260 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e090294-8c46-4038-a935-1eca729b6956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:02.843989 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e090294-8c46-4038-a935-1eca729b6956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:02.845232 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e090294-8c46-4038-a935-1eca729b6956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:02.845886 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-3e090294-8c46-4038-a935-1eca729b6956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:02.914154 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-3e090294-8c46-4038-a935-1eca729b6956 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 38186 microversion: 2.1 time: 0.090570 Dec 15 16:52:02.914817 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1569/2936] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:52:02 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 38186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:52:03.927655 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7d568673-3e08-493c-8f8d-ced7cadb61c4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:52:03.928684 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7d568673-3e08-493c-8f8d-ced7cadb61c4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:52:03.935945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d568673-3e08-493c-8f8d-ced7cadb61c4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:03.936401 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d568673-3e08-493c-8f8d-ced7cadb61c4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:03.937220 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d568673-3e08-493c-8f8d-ced7cadb61c4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:03.937663 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7d568673-3e08-493c-8f8d-ced7cadb61c4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:03.999345 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7d568673-3e08-493c-8f8d-ced7cadb61c4 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 38186 microversion: 2.1 time: 0.076231 Dec 15 16:52:03.999996 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1368/2937] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:52:03 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 38186 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:52:05.016831 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-82ace0fb-8da7-4986-809a-7da2eecfaecb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:52:05.018414 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-82ace0fb-8da7-4986-809a-7da2eecfaecb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:52:05.029799 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82ace0fb-8da7-4986-809a-7da2eecfaecb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:05.030542 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82ace0fb-8da7-4986-809a-7da2eecfaecb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:05.031823 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82ace0fb-8da7-4986-809a-7da2eecfaecb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:05.032584 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-82ace0fb-8da7-4986-809a-7da2eecfaecb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:05.107225 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-82ace0fb-8da7-4986-809a-7da2eecfaecb tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action" status: 200 len: 38317 microversion: 2.1 time: 0.097059 Dec 15 16:52:05.108271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1570/2938] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Dec 15 16:52:05 2021] POST /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/action => generated 38317 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:52:05.124808 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-b3607869-3c42-421d-a688-cf4fafa268b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:52:05.125731 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-b3607869-3c42-421d-a688-cf4fafa268b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:52:05.134547 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b3607869-3c42-421d-a688-cf4fafa268b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:05.134991 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b3607869-3c42-421d-a688-cf4fafa268b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:05.135769 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b3607869-3c42-421d-a688-cf4fafa268b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:52:05.136198 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-b3607869-3c42-421d-a688-cf4fafa268b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:52:05.160516 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-b3607869-3c42-421d-a688-cf4fafa268b1 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/ips" status: 200 len: 146 microversion: 2.1 time: 0.042399 Dec 15 16:52:05.161084 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1369/2939] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Dec 15 16:52:05 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:53:05.241003 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4080ff2c-8f63-4309-a229-f701a0a23839 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:53:05.241769 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4080ff2c-8f63-4309-a229-f701a0a23839 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:53:05.250850 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4080ff2c-8f63-4309-a229-f701a0a23839 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:05.251404 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4080ff2c-8f63-4309-a229-f701a0a23839 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:05.252374 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4080ff2c-8f63-4309-a229-f701a0a23839 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:05.252949 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4080ff2c-8f63-4309-a229-f701a0a23839 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:05.280684 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4080ff2c-8f63-4309-a229-f701a0a23839 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Going to try to terminate instance {{(pid=116021) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:53:05.374645 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4080ff2c-8f63-4309-a229-f701a0a23839 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 204 len: 0 microversion: 2.1 time: 0.139501 Dec 15 16:53:05.375292 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1571/2940] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:53:05 2021] DELETE /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:53:05.384386 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-14f3202e-8271-4faa-8758-e25df7b0ec68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:53:05.384975 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-14f3202e-8271-4faa-8758-e25df7b0ec68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:53:05.391158 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14f3202e-8271-4faa-8758-e25df7b0ec68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:05.391612 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14f3202e-8271-4faa-8758-e25df7b0ec68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:05.392389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14f3202e-8271-4faa-8758-e25df7b0ec68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:05.392861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-14f3202e-8271-4faa-8758-e25df7b0ec68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:05.529389 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.policy [None req-14f3202e-8271-4faa-8758-e25df7b0ec68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116022) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:53:05.537676 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-14f3202e-8271-4faa-8758-e25df7b0ec68 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1675 microversion: 2.1 time: 0.157940 Dec 15 16:53:05.538244 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1370/2941] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:53:05 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:53:06.559986 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-7ac8afaf-326b-4daa-9678-1e32e8606a8e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:53:06.561239 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-7ac8afaf-326b-4daa-9678-1e32e8606a8e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:53:06.571777 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ac8afaf-326b-4daa-9678-1e32e8606a8e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:06.572605 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ac8afaf-326b-4daa-9678-1e32e8606a8e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:06.573891 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ac8afaf-326b-4daa-9678-1e32e8606a8e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:06.574619 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-7ac8afaf-326b-4daa-9678-1e32e8606a8e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:06.816846 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-7ac8afaf-326b-4daa-9678-1e32e8606a8e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:53:06.824800 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-7ac8afaf-326b-4daa-9678-1e32e8606a8e tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1675 microversion: 2.1 time: 0.271702 Dec 15 16:53:06.825386 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1572/2942] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:53:06 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1675 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:53:07.582871 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [req-6c9cfdea-b8cc-45e1-93e0-276659c98479 req-51e2e470-ae75-4e19-8826-a81142edfec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6011fbb4-f50b-4f38-8125-0dcb7504d764", "name": "network-vif-deleted", "tag": "63970b4f-a92c-446f-9d02-3a2c0d7f63e3"}]} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:53:07.584403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:53:07.584403 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: warnings.warn(msg) Dec 15 16:53:07.592155 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-6c9cfdea-b8cc-45e1-93e0-276659c98479 req-51e2e470-ae75-4e19-8826-a81142edfec7 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:07.592699 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [req-6c9cfdea-b8cc-45e1-93e0-276659c98479 req-51e2e470-ae75-4e19-8826-a81142edfec7 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:07.604294 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.compute.server_external_events [req-6c9cfdea-b8cc-45e1-93e0-276659c98479 req-51e2e470-ae75-4e19-8826-a81142edfec7 service nova] Creating event network-vif-deleted:63970b4f-a92c-446f-9d02-3a2c0d7f63e3 for instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 on hv-cinder-82002 Dec 15 16:53:07.610119 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [req-6c9cfdea-b8cc-45e1-93e0-276659c98479 req-51e2e470-ae75-4e19-8826-a81142edfec7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030829 Dec 15 16:53:07.613708 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1371/2943] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:53:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:53:07.842699 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:53:07.843400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:53:07.849971 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:07.850495 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:07.851280 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:07.851710 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:07.885253 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:07.885616 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:07.886055 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lazy-loading 'fault' on Instance uuid 6011fbb4-f50b-4f38-8125-0dcb7504d764 {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:53:07.930407 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5686da93293e439eaf999b67fc154b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9264b7d2b1b4444f848035561e48c126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:53:07.938704 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-51bf6e3c-048c-4bc2-b8e8-101c5dd348e3 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 200 len: 1328 microversion: 2.1 time: 0.100136 Dec 15 16:53:07.939628 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1573/2944] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:53:07 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:53:08.961583 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7146efe6-6495-442f-acb3-3616a30fda3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:53:08.963097 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7146efe6-6495-442f-acb3-3616a30fda3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:53:08.974061 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7146efe6-6495-442f-acb3-3616a30fda3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:08.974796 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7146efe6-6495-442f-acb3-3616a30fda3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:08.976093 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7146efe6-6495-442f-acb3-3616a30fda3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:08.976861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7146efe6-6495-442f-acb3-3616a30fda3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:08.993498 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-7146efe6-6495-442f-acb3-3616a30fda3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] HTTP exception thrown: Instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 could not be found. Dec 15 16:53:08.994085 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7146efe6-6495-442f-acb3-3616a30fda3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Returning 404 to user: Instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:53:08.994914 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7146efe6-6495-442f-acb3-3616a30fda3b tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 404 len: 111 microversion: 2.1 time: 0.040774 Dec 15 16:53:08.995451 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1372/2945] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:53:08 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:53:09.003807 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-2b7101ae-d8f7-4ffb-91b5-934bc75e8aaa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '.version_select at 0x7f3a7c295670>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:53:09.022980 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-2b7101ae-d8f7-4ffb-91b5-934bc75e8aaa tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313486662" status: 202 len: 0 microversion: 2.1 time: 0.022763 Dec 15 16:53:09.023568 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1574/2946] 10.222.0.30 () {58 vars in 1220 bytes} [Wed Dec 15 16:53:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313486662 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:53:09.672992 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7ae4f912-d97f-405e-9d8b-1d94837c9267 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:53:09.673481 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-7ae4f912-d97f-405e-9d8b-1d94837c9267 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:53:09.680233 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ae4f912-d97f-405e-9d8b-1d94837c9267 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:09.680715 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ae4f912-d97f-405e-9d8b-1d94837c9267 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:09.681491 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ae4f912-d97f-405e-9d8b-1d94837c9267 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:09.681923 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-7ae4f912-d97f-405e-9d8b-1d94837c9267 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:09.694941 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-7ae4f912-d97f-405e-9d8b-1d94837c9267 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] HTTP exception thrown: Instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 could not be found. Dec 15 16:53:09.695517 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7ae4f912-d97f-405e-9d8b-1d94837c9267 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Returning 404 to user: Instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:53:09.696296 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7ae4f912-d97f-405e-9d8b-1d94837c9267 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 404 len: 111 microversion: 2.1 time: 0.027271 Dec 15 16:53:09.696883 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1373/2947] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:53:09 2021] DELETE /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:53:09.704920 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4e2c3cd4-ff9a-43e3-8082-8b40efff5f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:53:09.705538 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-4e2c3cd4-ff9a-43e3-8082-8b40efff5f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 6011fbb4-f50b-4f38-8125-0dcb7504d764] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:53:09.711641 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e2c3cd4-ff9a-43e3-8082-8b40efff5f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:09.712097 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e2c3cd4-ff9a-43e3-8082-8b40efff5f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:09.713287 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e2c3cd4-ff9a-43e3-8082-8b40efff5f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:53:09.713722 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-4e2c3cd4-ff9a-43e3-8082-8b40efff5f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:53:09.726912 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-4e2c3cd4-ff9a-43e3-8082-8b40efff5f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] HTTP exception thrown: Instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 could not be found. Dec 15 16:53:09.727506 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-4e2c3cd4-ff9a-43e3-8082-8b40efff5f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Returning 404 to user: Instance 6011fbb4-f50b-4f38-8125-0dcb7504d764 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:53:09.728330 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-4e2c3cd4-ff9a-43e3-8082-8b40efff5f18 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764" status: 404 len: 111 microversion: 2.1 time: 0.027336 Dec 15 16:53:09.728858 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1575/2948] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:53:09 2021] GET /compute/v2.1/servers/6011fbb4-f50b-4f38-8125-0dcb7504d764 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:54:10.688223 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:54:10.689017 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:54:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:54:18.908020 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:54:18.909110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:54:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:55:43.166051 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:55:43.166965 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:55:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:56:16.147471 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:56:16.148171 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:56:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:56:19.287268 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:56:19.288323 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:56:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:56:23.089206 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:56:23.090143 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:56:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:56:29.758142 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc1610e9-29fd-44f1-b8bd-4a18f0cf05e6] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 16:56:29.762861 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-83e78b3f-ff2a-4118-a07d-2ef417ef0caf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:56:29.763504 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-83e78b3f-ff2a-4118-a07d-2ef417ef0caf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:56:29.778919 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83e78b3f-ff2a-4118-a07d-2ef417ef0caf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:56:29.779920 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83e78b3f-ff2a-4118-a07d-2ef417ef0caf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:56:29.781087 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83e78b3f-ff2a-4118-a07d-2ef417ef0caf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:56:29.781741 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-83e78b3f-ff2a-4118-a07d-2ef417ef0caf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:56:29.816109 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-83e78b3f-ff2a-4118-a07d-2ef417ef0caf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Going to try to terminate instance {{(pid=116022) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:56:29.906110 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-83e78b3f-ff2a-4118-a07d-2ef417ef0caf tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "DELETE /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 204 len: 0 microversion: 2.20 time: 0.150652 Dec 15 16:56:29.906694 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1374/2949] 10.222.0.30 () {60 vars in 1279 bytes} [Wed Dec 15 16:56:29 2021] DELETE /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:56:29.912884 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dff3f257-401b-4f27-9475-8df7e46fa855] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 15 16:56:29.917720 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:56:29.918423 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:56:29.928678 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:56:29.929125 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:56:29.930338 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:56:29.930803 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:56:29.961862 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:56:29.962375 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:56:29.963213 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.objects.instance [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lazy-loading 'fault' on Instance uuid 134cc886-afce-4a89-b875-cdf6768bfd8f {{(pid=116021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:56:30.007132 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:56:30.014216 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:56:30.016302 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.policy [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7f047bf1080497290a18bff8b4e4337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb083b5a25444b3845b0f49b8b6f4d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116021) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:56:30.018333 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-6d8e827a-bbe4-4bf1-8b40-adbd3ff1aa79 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 200 len: 1543 microversion: 2.20 time: 0.106771 Dec 15 16:56:30.018946 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1576/2950] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:56:29 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 1543 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:56:31.057274 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6dd0442c-00be-497a-813e-33ef99d63997 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:56:31.059882 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-6dd0442c-00be-497a-813e-33ef99d63997 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] [instance: 134cc886-afce-4a89-b875-cdf6768bfd8f] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:56:31.075745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6dd0442c-00be-497a-813e-33ef99d63997 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:56:31.075745 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6dd0442c-00be-497a-813e-33ef99d63997 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:56:31.076050 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6dd0442c-00be-497a-813e-33ef99d63997 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:56:31.076390 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-6dd0442c-00be-497a-813e-33ef99d63997 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:56:31.080201 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc1610e9-29fd-44f1-b8bd-4a18f0cf05e6] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 51532. Dec 15 16:56:31.092266 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-6dd0442c-00be-497a-813e-33ef99d63997 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] HTTP exception thrown: Instance 134cc886-afce-4a89-b875-cdf6768bfd8f could not be found. Dec 15 16:56:31.092983 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-6dd0442c-00be-497a-813e-33ef99d63997 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] Returning 404 to user: Instance 134cc886-afce-4a89-b875-cdf6768bfd8f could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:56:31.093846 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-6dd0442c-00be-497a-813e-33ef99d63997 tempest-AttachVolumeShelveTestJSON-1746014621 tempest-AttachVolumeShelveTestJSON-1746014621-project] 10.222.0.30 "GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f" status: 404 len: 111 microversion: 2.20 time: 0.060532 Dec 15 16:56:31.094661 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1375/2951] 10.222.0.30 () {60 vars in 1276 bytes} [Wed Dec 15 16:56:31 2021] GET /compute/v2.1/servers/134cc886-afce-4a89-b875-cdf6768bfd8f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:56:31.637977 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] [dff3f257-401b-4f27-9475-8df7e46fa855] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 51552. Dec 15 16:56:31.800045 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [req-25f6d635-e608-41d6-94f9-8bce20c1400b req-d51aff0b-d1e4-45ab-b421-3251fc50b826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96293447-9fd5-4150-abbe-a00f77eb0094", "name": "network-vif-deleted", "tag": "fd46da54-de89-4927-beb0-fce5e08a5d2a"}]} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:56:31.801701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:56:31.801701 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: warnings.warn(msg) Dec 15 16:56:31.808852 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-25f6d635-e608-41d6-94f9-8bce20c1400b req-d51aff0b-d1e4-45ab-b421-3251fc50b826 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:56:31.809400 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [req-25f6d635-e608-41d6-94f9-8bce20c1400b req-d51aff0b-d1e4-45ab-b421-3251fc50b826 service nova] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:56:31.820558 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.compute.server_external_events [req-25f6d635-e608-41d6-94f9-8bce20c1400b req-d51aff0b-d1e4-45ab-b421-3251fc50b826 service nova] Creating event network-vif-deleted:fd46da54-de89-4927-beb0-fce5e08a5d2a for instance 96293447-9fd5-4150-abbe-a00f77eb0094 on hv-cinder-82002 Dec 15 16:56:31.826871 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [req-25f6d635-e608-41d6-94f9-8bce20c1400b req-d51aff0b-d1e4-45ab-b421-3251fc50b826 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209961 Dec 15 16:56:31.827504 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1577/2952] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Dec 15 16:56:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:56:35.826471 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7fdd10d7-5475-4d68-ade7-f1931b7b61a9 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Action: 'create', calling method: .version_select at 0x7f3a7c288b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1895339040", "metadata": {"Type": "work"}}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:56:35.827859 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-7fdd10d7-5475-4d68-ade7-f1931b7b61a9 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:56:35.828690 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-7fdd10d7-5475-4d68-ade7-f1931b7b61a9 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.117652 Dec 15 16:56:35.829223 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1376/2953] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Dec 15 16:56:35 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:56:35.839826 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d936d28e-41df-4c48-ae36-83977f31d812 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Action: 'create', calling method: .version_select at 0x7f3a7cb7b310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1192903057", "metadata": {"Type": "work"}}} {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:56:35.841271 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-d936d28e-41df-4c48-ae36-83977f31d812 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:56:35.842074 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-d936d28e-41df-4c48-ae36-83977f31d812 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007371 Dec 15 16:56:35.842592 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1578/2954] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Dec 15 16:56:35 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:56:35.851541 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3383e6b2-b249-455a-81d2-5ce553c7b0c7 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Action: 'create', calling method: .version_select at 0x7f3a7c0513a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-407934495", "metadata": {"Type": "work"}}} {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:56:35.852732 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-3383e6b2-b249-455a-81d2-5ce553c7b0c7 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:56:35.853522 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-3383e6b2-b249-455a-81d2-5ce553c7b0c7 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005592 Dec 15 16:56:35.855082 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1377/2955] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Dec 15 16:56:35 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:56:35.864740 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-209a6d7a-a343-4643-9ec7-a84c6b511f78 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Calling method '.version_select at 0x7f3a7c2953a0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:56:35.892880 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-209a6d7a-a343-4643-9ec7-a84c6b511f78 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] HTTP exception thrown: Volume tempest-invalid-90309615 could not be found. Dec 15 16:56:35.893561 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-209a6d7a-a343-4643-9ec7-a84c6b511f78 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Returning 404 to user: Volume tempest-invalid-90309615 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:56:35.894660 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-209a6d7a-a343-4643-9ec7-a84c6b511f78 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-90309615" status: 404 len: 97 microversion: 2.1 time: 0.033611 Dec 15 16:56:35.895251 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1579/2956] 10.222.0.30 () {58 vars in 1211 bytes} [Wed Dec 15 16:56:35 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-90309615 => generated 97 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 15 16:56:35.904150 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-956f6868-8452-4198-a7ae-0b95a0532d51 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003772 Dec 15 16:56:35.904705 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1378/2957] 10.222.0.30 () {58 vars in 1139 bytes} [Wed Dec 15 16:56:35 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 16:56:35.912947 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-29b9ee83-1222-4a93-b58b-6b629e8045e9 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003592 Dec 15 16:56:35.913455 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1580/2958] 10.222.0.30 () {58 vars in 1136 bytes} [Wed Dec 15 16:56:35 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 16:56:35.922042 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bbff1838-ef7a-4f7e-be6c-71dcfd4cba78 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Calling method '.version_select at 0x7f3a7c2884c0>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:56:36.052310 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-bbff1838-ef7a-4f7e-be6c-71dcfd4cba78 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] HTTP exception thrown: Volume bda9b345-b404-4669-9612-01271356364c could not be found. Dec 15 16:56:36.052945 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-bbff1838-ef7a-4f7e-be6c-71dcfd4cba78 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Returning 404 to user: Volume bda9b345-b404-4669-9612-01271356364c could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:56:36.053780 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-bbff1838-ef7a-4f7e-be6c-71dcfd4cba78 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/bda9b345-b404-4669-9612-01271356364c" status: 404 len: 109 microversion: 2.1 time: 0.135226 Dec 15 16:56:36.054322 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1379/2959] 10.222.0.30 () {58 vars in 1247 bytes} [Wed Dec 15 16:56:35 2021] DELETE /compute/v2.1/os-volumes/bda9b345-b404-4669-9612-01271356364c => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:56:36.063675 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e064c19-a228-49bb-97a8-1f9bcfe759e8 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Calling method '.version_select at 0x7f3a7c3530d0>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:56:36.090237 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-1e064c19-a228-49bb-97a8-1f9bcfe759e8 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] HTTP exception thrown: Volume 5ae349c1-cd00-43b2-ba5f-62c7fd2d062c could not be found. Dec 15 16:56:36.090870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-1e064c19-a228-49bb-97a8-1f9bcfe759e8 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] Returning 404 to user: Volume 5ae349c1-cd00-43b2-ba5f-62c7fd2d062c could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:56:36.091698 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-1e064c19-a228-49bb-97a8-1f9bcfe759e8 tempest-VolumesNegativeTest-567843719 tempest-VolumesNegativeTest-567843719-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/5ae349c1-cd00-43b2-ba5f-62c7fd2d062c" status: 404 len: 109 microversion: 2.1 time: 0.031675 Dec 15 16:56:36.092268 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1581/2960] 10.222.0.30 () {58 vars in 1244 bytes} [Wed Dec 15 16:56:36 2021] GET /compute/v2.1/os-volumes/5ae349c1-cd00-43b2-ba5f-62c7fd2d062c => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:57:30.712664 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:57:30.713900 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:57:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:57:38.931728 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:57:38.932647 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:57:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:59:03.185283 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:59:03.185876 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:59:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:59:36.171768 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:59:36.172673 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:59:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:59:36.747523 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc1610e9-29fd-44f1-b8bd-4a18f0cf05e6] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 16:59:36.751327 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-94e242d5-c356-4daf-9047-8ce778f3ff37 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:59:36.751816 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.compute.api [None req-94e242d5-c356-4daf-9047-8ce778f3ff37 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116022) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:59:36.758105 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94e242d5-c356-4daf-9047-8ce778f3ff37 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:59:36.758562 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94e242d5-c356-4daf-9047-8ce778f3ff37 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:59:36.759609 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94e242d5-c356-4daf-9047-8ce778f3ff37 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:59:36.760043 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG oslo_concurrency.lockutils [None req-94e242d5-c356-4daf-9047-8ce778f3ff37 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:59:36.772765 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.wsgi [None req-94e242d5-c356-4daf-9047-8ce778f3ff37 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] HTTP exception thrown: Instance 58544761-395a-4b54-876b-38750b3d8cf1 could not be found. Dec 15 16:59:36.773343 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: DEBUG nova.api.openstack.wsgi [None req-94e242d5-c356-4daf-9047-8ce778f3ff37 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Returning 404 to user: Instance 58544761-395a-4b54-876b-38750b3d8cf1 could not be found. {{(pid=116022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:59:36.774162 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO nova.api.openstack.requestlog [None req-94e242d5-c356-4daf-9047-8ce778f3ff37 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "DELETE /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 404 len: 111 microversion: 2.1 time: 0.028959 Dec 15 16:59:36.774896 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: [pid: 116022|app: 0|req: 1380/2961] 10.222.0.30 () {58 vars in 1238 bytes} [Wed Dec 15 16:59:36 2021] DELETE /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:59:36.781734 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dff3f257-401b-4f27-9475-8df7e46fa855] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 16:59:36.785310 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-52c9f2f8-1897-45c7-9741-f65546466d13 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Calling method '>' {{(pid=116021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:59:36.786036 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.compute.api [None req-52c9f2f8-1897-45c7-9741-f65546466d13 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] [instance: 58544761-395a-4b54-876b-38750b3d8cf1] Fetching instance by UUID {{(pid=116021) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:59:36.792910 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52c9f2f8-1897-45c7-9741-f65546466d13 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:59:36.793366 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52c9f2f8-1897-45c7-9741-f65546466d13 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:59:36.794153 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52c9f2f8-1897-45c7-9741-f65546466d13 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:59:36.794603 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG oslo_concurrency.lockutils [None req-52c9f2f8-1897-45c7-9741-f65546466d13 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Lock "144f1872-fd4a-4f70-bcac-e90acefa618e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:59:36.807887 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.wsgi [None req-52c9f2f8-1897-45c7-9741-f65546466d13 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] HTTP exception thrown: Instance 58544761-395a-4b54-876b-38750b3d8cf1 could not be found. Dec 15 16:59:36.808474 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: DEBUG nova.api.openstack.wsgi [None req-52c9f2f8-1897-45c7-9741-f65546466d13 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] Returning 404 to user: Instance 58544761-395a-4b54-876b-38750b3d8cf1 could not be found. {{(pid=116021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:59:36.809332 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO nova.api.openstack.requestlog [None req-52c9f2f8-1897-45c7-9741-f65546466d13 tempest-AttachVolumeTestJSON-1701833091 tempest-AttachVolumeTestJSON-1701833091-project] 10.222.0.30 "GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1" status: 404 len: 111 microversion: 2.1 time: 0.029400 Dec 15 16:59:36.809870 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: [pid: 116021|app: 0|req: 1582/2962] 10.222.0.30 () {58 vars in 1235 bytes} [Wed Dec 15 16:59:36 2021] GET /compute/v2.1/servers/58544761-395a-4b54-876b-38750b3d8cf1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:59:39.315503 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:59:39.316095 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 16:59:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:59:43.113236 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:59:43.114115 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 16:59:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 17:00:50.741198 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 17:00:50.741849 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 17:00:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 17:00:58.960320 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 17:00:58.960976 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 17:00:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 17:02:23.204123 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 17:02:23.205043 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 17:02:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 17:02:56.194314 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 17:02:56.195173 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 17:02:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 17:02:59.338256 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 17:02:59.339324 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 17:02:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 17:03:03.135064 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 17:03:03.135614 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 17:03:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 17:04:10.760477 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 17:04:10.761822 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 17:04:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 17:04:18.983418 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 17:04:18.984300 dv-cinder-820027-2-iscsi devstack@n-api.service[116022]: Wed Dec 15 17:04:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 17:05:43.228975 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 17:05:43.229853 dv-cinder-820027-2-iscsi devstack@n-api.service[116021]: Wed Dec 15 17:05:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!